Sep 08 07:14:17 devstack cinder-volume[76311]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 07:14:17 devstack cinder-volume[76311]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 07:14:17 devstack cinder-volume[76311]: we strongly recommend against using it for new projects. Sep 08 07:14:17 devstack cinder-volume[76311]: If you are already using Eventlet, we recommend migrating to a different Sep 08 07:14:17 devstack cinder-volume[76311]: framework. For more detail see Sep 08 07:14:17 devstack cinder-volume[76311]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 07:14:17 devstack cinder-volume[76311]: import eventlet # noqa Sep 08 07:14:20 devstack cinder-volume[76311]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 07:14:20 devstack cinder-volume[76311]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 07:14:20 devstack cinder-volume[76311]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 07:14:21 devstack cinder-volume[76311]: INFO dbcounter [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Registered counter for database cinder Sep 08 07:14:21 devstack cinder-volume[76311]: DEBUG oslo_db.sqlalchemy.engines [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76311) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:14:22 devstack cinder-volume[76311]: DEBUG dbcounter [-] [76311] Writer thread running {{(pid=76311) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 07:14:22 devstack cinder-volume[76311]: INFO cinder.rpc [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 07:14:22 devstack cinder-volume[76311]: INFO cinder.rpc [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 07:14:22 devstack cinder-volume[76311]: DEBUG oslo_db.sqlalchemy.engines [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76311) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:14:22 devstack cinder-volume[76311]: INFO cinder.volume.manager [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Determined volume DB was empty at startup. Sep 08 07:14:22 devstack cinder-volume[76311]: DEBUG cinder.volume.manager [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76311) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 07:14:22 devstack cinder-volume[76311]: INFO cinder.volume.manager [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 07:14:22 devstack cinder-volume[76311]: WARNING stevedore.named [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 07:14:22 devstack cinder-volume[76311]: WARNING castellan.key_manager [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 07:14:22 devstack cinder-volume[76311]: WARNING cinder.keymgr.conf_key_mgr [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 07:14:22 devstack cinder-volume[76311]: DEBUG cinder.volume.drivers.lvm [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76311) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 08 07:14:22 devstack cinder-volume[76311]: DEBUG oslo_concurrency.processutils [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76311) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:22 devstack cinder-volume[76311]: DEBUG oslo_concurrency.processutils [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] CMD "cinder-rtstool verify" returned: 0 in 0.514s {{(pid=76311) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:22 devstack cinder-volume[76311]: DEBUG oslo_db.sqlalchemy.engines [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76311) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:14:22 devstack cinder-volume[76311]: INFO cinder.rpc [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 08 07:14:22 devstack cinder-volume[76311]: INFO cinder.rpc [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 08 07:14:22 devstack cinder-volume[76311]: WARNING stevedore.named [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 07:14:22 devstack cinder-volume[76311]: WARNING castellan.key_manager [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 07:14:22 devstack cinder-volume[76311]: INFO cinder.volume.manager [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_db.sqlalchemy.engines [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76311) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:14:23 devstack cinder-volume[76311]: INFO oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Starting 1 workers Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Started child 76497 {{(pid=76311) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Full set of CONF: {{(pid=76311) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] ******************************************************************************** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Configuration options gathered from: {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] ================================================================================ {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] allow_availability_zone_fallback = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] allow_compression_on_image_upload = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] allowed_direct_url_schemes = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] api_rate_limit = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] auth_strategy = keystone {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] az_cache_duration = 3600 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_availability_zone = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_host = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_stats_polling_interval = 60 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backup_api_class = cinder.backup.api.API {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backup_name_template = backup-%s {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backup_use_same_host = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backup_use_temp_snapshot = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] chap_password = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] chap_username = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cinder_internal_tenant_project_id = 4e49160bcd8141e8a3f92c989696cc4d {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cinder_internal_tenant_user_id = 4e077e63051f430abf09ef02812a3332 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cloned_volume_same_az = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cluster = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] compression_format = gzip {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] compute_api_class = cinder.compute.nova.API {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] config_dir = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] config_source = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] control_exchange = openstack {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] debug = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] default_availability_zone = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76497]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] default_group_type = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] default_volume_type = lvmdriver-1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] disk_geometry = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] driver_client_cert = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] driver_client_cert_key = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] driver_data_namespace = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] driver_ssl_cert_path = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] driver_ssl_cert_verify = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] driver_use_ssl = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] enable_force_upload = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] enable_new_services = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] enable_unsupported_driver = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] enabled_backends = ['lvmdriver-1'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] enforce_multipath_for_image_xfer = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] filter_function = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_api_insecure = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_api_servers = ['http://192.168.122.62/image'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_api_ssl_compression = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_ca_certificates_file = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_catalog_info = image:glance:publicURL {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_certfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_keyfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_num_retries = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance_request_timeout = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] goodness_function = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] graceful_shutdown_timeout = 5 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] group_api_class = cinder.group.api.API {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] host = devstack {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_compress_on_upload = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_conversion_address_space_limit = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_conversion_cpu_limit = 60 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_conversion_disable = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_upload_use_cinder_backend = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_upload_use_internal_tenant = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_volume_cache_enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_volume_cache_max_count = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] image_volume_cache_max_size_gb = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] init_host_max_objects_retrieval = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] instance_format = [instance: %(uuid)s] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] iscsi_target_flags = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] iscsi_write_cache = on {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] iser_helper = tgtadm {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] iser_ip_address = 192.168.122.62 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] iser_port = 3260 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] log_color = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] log_config_append = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] log_dir = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] log_file = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] log_options = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] log_rotate_interval = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] log_rotate_interval_type = days {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] log_rotation_type = none {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] max_age = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] max_logfile_count = 30 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] max_logfile_size_mb = 200 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] max_over_subscription_ratio = 20.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] message_reap_interval = 86400 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] message_ttl = 2592000 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] migration_create_volume_timeout_secs = 300 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] monkey_patch = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] monkey_patch_modules = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] my_ip = 192.168.122.62 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] no_snapshot_gb_quota = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] num_iser_scan_tries = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] num_shell_tries = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] num_volume_device_scan_tries = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] nvmeof_conn_info_version = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] nvmet_ns_id = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] nvmet_port_id = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] osapi_max_limit = 1000 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] osapi_volume_ext_list = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] osapi_volume_listen = 0.0.0.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] osapi_volume_listen_port = 8776 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] osapi_volume_use_ssl = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] osapi_volume_workers = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] per_volume_size_limit = -1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] periodic_fuzzy_delay = 60 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] periodic_interval = 60 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] project_id_regex = [0-9a-f\-]+ {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] public_endpoint = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] publish_errors = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] quota_backup_gigabytes = 1000 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] quota_backups = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] quota_gigabytes = 1000 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] quota_groups = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] quota_snapshots = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] quota_volumes = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] rate_limit_burst = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] rate_limit_except_level = CRITICAL {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] rate_limit_interval = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] reinit_driver_count = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] replication_device = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] report_discard_supported = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] report_interval = 120 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] reservation_clean_interval = 86400 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] reservation_expire = 86400 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] reserved_image_namespaces = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] reserved_percentage = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] rpc_response_timeout = 120 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] run_external_periodic_tasks = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] scst_target_driver = iscsi {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] scst_target_iqn_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_down_time = 720 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] shell_completion = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] snapshot_name_template = snapshot-%s {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] snapshot_same_host = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] split_loggers = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] state_path = /opt/stack/data/cinder {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] storage_availability_zone = nova {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] storage_protocol = iSCSI {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] syslog_log_facility = LOG_USER {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] target_helper = lioadm {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] target_ip_address = 192.168.122.62 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] target_port = 3260 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] target_protocol = iscsi {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] target_secondary_ip_addresses = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] trace_flags = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] transfer_api_class = cinder.transfer.api.API {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] transport_url = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] until_refresh = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] use_chap_auth = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] use_default_quota_class = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] use_journal = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] use_json = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] use_multipath_for_image_xfer = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] use_stderr = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] use_syslog = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] verify_glance_signatures = enabled {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_api_class = cinder.volume.api.API {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_backend_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_clear = zero {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_clear_ionice = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_clear_size = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_copy_bps_limit = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_dd_blocksize = 1M {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_name_template = volume-%s {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_service_inithost_offload = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volume_usage_audit_period = month {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] zoning_mode = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_concurrency.disable_process_locking = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.auth_section = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.auth_type = password {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.auth_version = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.cache = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.certfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.delay_auth_decision = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.http_connect_timeout = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.include_service_catalog = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.insecure = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.interface = public {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.keyfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_password = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcache_username = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.region_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.service_token_roles_required = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.service_type = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.token_cache_time = 300 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.62/identity {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.backend = dogpile.cache.null {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.backend_argument = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.backend_expiration_time = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.config_prefix = cache.oslo {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.debug_cache_backend = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.enable_retry_client = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.enable_socket_keepalive = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.expiration_time = 600 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.hashclient_retry_attempts = 2 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.memcache_dead_retry = 300 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.memcache_pool_maxsize = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.memcache_sasl_enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.password = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.proxies = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.redis_db = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.redis_sentinel_service_name = mymaster {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.redis_server = localhost:6379 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.retry_attempts = 2 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.retry_delay = 0.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.socket_keepalive_count = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.socket_keepalive_idle = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.socket_keepalive_interval = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.socket_timeout = 1.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.tls_allowed_ciphers = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.tls_cafile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.tls_certfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.tls_enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.tls_keyfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cache.username = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] coordination.backend_url = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.asyncio_connection = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.asyncio_slave_connection = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.backend = sqlalchemy {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.connection = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.connection_debug = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.connection_parameters = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.connection_recycle_time = 3600 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.connection_trace = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.db_inc_retry_interval = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.db_max_retries = 20 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.db_max_retry_interval = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.db_retry_interval = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.max_overflow = 50 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.max_pool_size = 5 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76497]: INFO cinder.volume.manager [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.max_retries = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.mysql_wsrep_sync_wait = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.pool_timeout = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.retry_interval = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.slave_connection = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.sqlite_synchronous = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.synchronous_reader = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] database.use_db_reconnect = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_tracing.insecure = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.connection_string = messaging:// {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.es_doc_type = notification {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.es_scroll_size = 10000 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.es_scroll_time = 2m {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.filter_error_trace = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.hmac_keys = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.sentinel_service_name = mymaster {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.socket_timeout = 0.1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.trace_requests = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler.trace_sqlalchemy = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler_jaeger.process_tags = {} {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler_jaeger.service_name_prefix = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] profiler_otlp.service_name_prefix = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.enforce_new_defaults = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.policy_default_rule = default {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.policy_file = policy.yaml {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_policy.remote_timeout = 60.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] privsep_osbrick.group = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] privsep_osbrick.helper_command = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] privsep_osbrick.user = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cinder_sys_admin.group = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cinder_sys_admin.helper_command = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] cinder_sys_admin.user = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.auth_section = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.auth_type = password {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.cafile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.certfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.collect_timing = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.insecure = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.keyfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.send_service_user_token = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.split_loggers = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.timeout = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.tls_ciphers = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] service_user.tls_min_version = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.auth_section = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.auth_type = password {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.certfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.collect_timing = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.insecure = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.keyfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.region_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.split_loggers = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.timeout = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.tls_ciphers = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] glance.tls_min_version = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.backend_availability_zone = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.chap_password = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.chap_username = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.disk_geometry = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.driver_client_cert = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.driver_client_cert_key = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.driver_data_namespace = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.driver_use_ssl = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.enable_unsupported_driver = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.extra_capabilities = {} {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.filter_function = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.goodness_function = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.iscsi_target_flags = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.iscsi_write_cache = on {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.iser_helper = tgtadm {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.iser_ip_address = 192.168.122.62 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.iser_port = 3260 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.lvm_mirrors = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.lvm_share_target = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.lvm_type = auto {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.num_shell_tries = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.nvmet_port_id = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.replication_device = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.report_discard_supported = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.reserved_percentage = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.scst_target_driver = iscsi {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.scst_target_iqn_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.storage_protocol = iSCSI {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.target_helper = tgtadm {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.target_ip_address = 192.168.122.62 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.target_port = 3260 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.target_protocol = iscsi {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.trace_flags = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.unique_fqdn_network = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.use_chap_auth = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volume_backend_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volume_clear = zero {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volume_clear_ionice = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volume_clear_size = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volume_group = cinder-volumes {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_reports.file_event_handler = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_reports.log_dir = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.backend_availability_zone = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.backend_host = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.chap_password = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.chap_username = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.chiscsi_conf = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.disk_geometry = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.driver_client_cert = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.driver_data_namespace = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.driver_use_ssl = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.extra_capabilities = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.filter_function = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.goodness_function = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.iser_helper = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.iser_ip_address = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.iser_port = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.iser_target_prefix = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.lvm_conf_file = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.lvm_mirrors = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.lvm_share_target = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack sudo[76543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.lvm_type = auto {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack sudo[76543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.num_shell_tries = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.nvmet_port_id = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.replication_device = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.report_discard_supported = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.reserved_percentage = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.scst_target_driver = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.storage_protocol = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.target_helper = lioadm {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.target_ip_address = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.target_port = 3260 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.target_protocol = iscsi {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.trace_flags = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.use_chap_auth = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volume_clear = zero {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volume_clear_size = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] lvmdriver-1.volumes_dir = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.ssl = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.ssl_version = {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_notifications.driver = [] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_notifications.retry = -1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] oslo_messaging_notifications.transport_url = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] key_manager.fixed_key = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.barbican_api_version = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.barbican_endpoint = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.barbican_endpoint_type = public {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.barbican_region_name = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.cafile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.certfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.collect_timing = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.insecure = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.keyfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.number_of_retries = 60 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.retry_delay = 1 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.send_service_user_token = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.split_loggers = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.timeout = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.tls_ciphers = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.tls_min_version = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.verify_ssl = True {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican.verify_ssl_path = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.auth_section = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.auth_type = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.cafile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.certfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.collect_timing = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.insecure = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.keyfile = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.split_loggers = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.timeout = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.tls_ciphers = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] barbican_service_user.tls_min_version = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.approle_role_id = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.approle_secret_id = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.auth_method = approle {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.auth_path = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.kv_mountpoint = secret {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.kv_path = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.kv_version = 2 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.namespace = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.root_token_id = **** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.ssl_ca_crt_file = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.timeout = 60.0 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.token_file = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.token_role = None {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.use_ssl = False {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:14:23 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] ******************************************************************************** {{(pid=76311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 07:14:23 devstack sudo[76543]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:23 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:14:23 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:23 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.288s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:14:23 devstack cinder-volume[76497]: INFO cinder.brick.local_dev.lvm [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:23 devstack sudo[76774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 07:14:23 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:24 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:24 devstack cinder-volume[76497]: DEBUG cinder.brick.local_dev.lvm [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76497) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 08 07:14:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:24 devstack sudo[76864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:14:24 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:24 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.518s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:24 devstack sudo[77031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:14:24 devstack sudo[77031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:25 devstack sudo[77031]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:25 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:25 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:25 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:25 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:25 devstack sudo[77111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 08 07:14:25 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:25 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:25 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.310s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:25 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:25 devstack sudo[77154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 07:14:25 devstack sudo[77154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:25 devstack sudo[77154]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:25 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:25 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:25 devstack sudo[77198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 07:14:25 devstack sudo[77198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:26 devstack sudo[77198]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:26 devstack sudo[77209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:14:26 devstack sudo[77209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:26 devstack sudo[77209]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:26 devstack sudo[77290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:14:26 devstack sudo[77290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:26 devstack sudo[77290]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:26 devstack sudo[77300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:14:26 devstack sudo[77300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:26 devstack sudo[77300]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:26 devstack cinder-volume[76497]: INFO cinder.volume.drivers.lvm [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:26 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:26 devstack sudo[77304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:14:26 devstack sudo[77304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:27 devstack sudo[77304]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:27 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:27 devstack cinder-volume[76497]: DEBUG cinder.volume.drivers.lvm [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Updating volume stats {{(pid=76497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 07:14:27 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:27 devstack sudo[77307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 07:14:27 devstack sudo[77307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:27 devstack sudo[77307]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:27 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:27 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:27 devstack sudo[77310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:14:27 devstack sudo[77310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:27 devstack sudo[77310]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:27 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:27 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:27 devstack sudo[77313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:14:27 devstack sudo[77313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:27 devstack sudo[77313]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:27 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:27 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:27 devstack sudo[77316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:14:27 devstack sudo[77316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:28 devstack sudo[77316]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:28 devstack cinder-volume[76497]: INFO cinder.volume.driver [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Driver hasn't implemented _init_vendor_properties() Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG cinder.volume.driver [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76497) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG oslo_db.sqlalchemy.engines [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76497) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG dbcounter [-] [76497] Writer thread running {{(pid=76497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG cinder.db.api [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Building query based on filter {{(pid=76497) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG cinder.image.image_utils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76497) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 07:14:28 devstack cinder-volume[76497]: INFO cinder.keymgr.migration [None req-249c831d-4919-4340-b846-8138fa70038d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG cinder.volume.drivers.lvm [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Updating volume stats {{(pid=76497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:28 devstack sudo[77320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 07:14:28 devstack sudo[77320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:28 devstack sudo[77320]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:28 devstack sudo[77324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:14:28 devstack sudo[77324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:28 devstack sudo[77324]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:28 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:28 devstack sudo[77327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:14:28 devstack sudo[77327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:29 devstack sudo[77327]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:29 devstack sudo[77331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:14:29 devstack sudo[77331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:29 devstack sudo[77331]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG cinder.manager [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Notifying Schedulers of capabilities ... {{(pid=76497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:14:29 devstack cinder-volume[76497]: INFO cinder.volume.manager [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Driver initialization completed successfully. Sep 08 07:14:29 devstack cinder-volume[76497]: INFO cinder.manager [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Initiating service 2 cleanup Sep 08 07:14:29 devstack cinder-volume[76497]: INFO cinder.manager [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Service 2 cleanup completed. Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG cinder.service [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Creating RPC server for service cinder-volume {{(pid=76497) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG cinder.service [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76497) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 07:14:29 devstack cinder-volume[76497]: INFO cinder.volume.manager [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG cinder.volume.drivers.lvm [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Updating volume stats {{(pid=76497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:29 devstack sudo[77334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 07:14:29 devstack sudo[77334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:29 devstack sudo[77334]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:29 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:29 devstack sudo[77342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:14:29 devstack sudo[77342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:30 devstack sudo[77342]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:30 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:30 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:30 devstack sudo[77345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:14:30 devstack sudo[77345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:30 devstack sudo[77345]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:30 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:30 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:14:30 devstack sudo[77348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:14:30 devstack sudo[77348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:14:30 devstack sudo[77348]: pam_unix(sudo:session): session closed for user root Sep 08 07:14:30 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:14:30 devstack cinder-volume[76497]: INFO cinder.volume.manager [None req-6569b31b-92ed-4543-81fc-2ba5e368359b None None] Driver post RPC initialization completed successfully. Sep 08 07:14:33 devstack cinder-volume[76311]: DEBUG dbcounter [-] [76311] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76311) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:14:39 devstack cinder-volume[76497]: DEBUG dbcounter [-] [76497] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:14:40 devstack cinder-volume[76497]: DEBUG dbcounter [-] [76497] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:15:23 devstack cinder-volume[76497]: DEBUG oslo_service.periodic_task [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:15:23 devstack cinder-volume[76497]: DEBUG cinder.volume.drivers.lvm [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Updating volume stats {{(pid=76497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 07:15:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:15:23 devstack sudo[79286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 07:15:23 devstack sudo[79286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:15:23 devstack sudo[79286]: pam_unix(sudo:session): session closed for user root Sep 08 07:15:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:15:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:15:23 devstack sudo[79289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:15:23 devstack sudo[79289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:15:24 devstack sudo[79289]: pam_unix(sudo:session): session closed for user root Sep 08 07:15:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:15:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:15:24 devstack sudo[79292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:15:24 devstack sudo[79292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:15:24 devstack sudo[79292]: pam_unix(sudo:session): session closed for user root Sep 08 07:15:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:15:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:15:24 devstack sudo[79295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:15:24 devstack sudo[79295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:15:24 devstack sudo[79295]: pam_unix(sudo:session): session closed for user root Sep 08 07:15:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:15:24 devstack cinder-volume[76497]: DEBUG cinder.manager [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Notifying Schedulers of capabilities ... {{(pid=76497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:15:24 devstack cinder-volume[76497]: DEBUG oslo_service.periodic_task [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running periodic task VolumeManager._thread_info {{(pid=76497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:15:24 devstack cinder-volume[76497]: DEBUG cinder.volume.manager [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] thread count: 6 {{(pid=76497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:15:24 devstack cinder-volume[76497]: DEBUG cinder.volume.manager [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] thread info: [<_MainThread(MainThread, started 125602146975872)>, , , , , ] {{(pid=76497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:16:23 devstack cinder-volume[76497]: DEBUG oslo_service.periodic_task [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:16:23 devstack cinder-volume[76497]: DEBUG cinder.volume.drivers.lvm [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Updating volume stats {{(pid=76497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 07:16:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:16:23 devstack sudo[82592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 07:16:23 devstack sudo[82592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:16:23 devstack sudo[82592]: pam_unix(sudo:session): session closed for user root Sep 08 07:16:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:16:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:16:23 devstack sudo[82595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:16:23 devstack sudo[82595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:16:24 devstack sudo[82595]: pam_unix(sudo:session): session closed for user root Sep 08 07:16:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:16:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:16:24 devstack sudo[82600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:16:24 devstack sudo[82600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:16:24 devstack sudo[82600]: pam_unix(sudo:session): session closed for user root Sep 08 07:16:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:16:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:16:24 devstack sudo[82603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:16:24 devstack sudo[82603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:16:24 devstack sudo[82603]: pam_unix(sudo:session): session closed for user root Sep 08 07:16:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:16:24 devstack cinder-volume[76497]: DEBUG cinder.manager [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Notifying Schedulers of capabilities ... {{(pid=76497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:16:40 devstack cinder-volume[76497]: DEBUG dbcounter [-] [76497] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:17:23 devstack cinder-volume[76497]: DEBUG oslo_service.periodic_task [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running periodic task VolumeManager._thread_info {{(pid=76497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:17:23 devstack cinder-volume[76497]: DEBUG cinder.volume.manager [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] thread count: 6 {{(pid=76497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:17:23 devstack cinder-volume[76497]: DEBUG cinder.volume.manager [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] thread info: [<_MainThread(MainThread, started 125602146975872)>, , , , , ] {{(pid=76497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:18:23 devstack cinder-volume[76497]: DEBUG oslo_service.periodic_task [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:18:23 devstack cinder-volume[76497]: DEBUG cinder.volume.drivers.lvm [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Updating volume stats {{(pid=76497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 07:18:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:18:23 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 07:18:23 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:18:23 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Sep 08 07:18:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:18:23 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:18:23 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:18:23 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:18:24 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Sep 08 07:18:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:18:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:18:24 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 07:18:24 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:18:24 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Sep 08 07:18:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:18:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:18:24 devstack sudo[85826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 07:18:24 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:18:24 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root Sep 08 07:18:24 devstack cinder-volume[76497]: DEBUG oslo_concurrency.processutils [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:18:24 devstack cinder-volume[76497]: DEBUG cinder.manager [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Notifying Schedulers of capabilities ... {{(pid=76497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:18:24 devstack cinder-volume[76497]: DEBUG oslo_service.periodic_task [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] Running periodic task VolumeManager._thread_info {{(pid=76497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:18:24 devstack cinder-volume[76497]: DEBUG cinder.volume.manager [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] thread count: 6 {{(pid=76497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:18:24 devstack cinder-volume[76497]: DEBUG cinder.volume.manager [None req-c638c80a-9c2a-46f8-8bdd-d3e35fa13828 None None] thread info: [<_MainThread(MainThread, started 125602146975872)>, , , , , ] {{(pid=76497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:18:40 devstack cinder-volume[76497]: DEBUG dbcounter [-] [76497] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:18:51 devstack cinder-volume[76311]: INFO oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Caught SIGTERM, stopping children Sep 08 07:18:51 devstack cinder-volume[76311]: DEBUG oslo_concurrency.lockutils [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Acquiring lock "singleton_lock" {{(pid=76311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 07:18:51 devstack cinder-volume[76311]: DEBUG oslo_concurrency.lockutils [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Acquired lock "singleton_lock" {{(pid=76311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 07:18:51 devstack cinder-volume[76311]: DEBUG oslo_concurrency.lockutils [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Releasing lock "singleton_lock" {{(pid=76311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 07:18:51 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Stop services. {{(pid=76311) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 07:18:51 devstack cinder-volume[76311]: DEBUG oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Killing children. {{(pid=76311) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 07:18:51 devstack cinder-volume[76311]: INFO oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Waiting on 1 children to exit Sep 08 07:18:54 devstack cinder-volume[76497]: DEBUG oslo_concurrency.lockutils [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Acquiring lock "singleton_lock" {{(pid=76497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 07:18:54 devstack cinder-volume[76497]: DEBUG oslo_concurrency.lockutils [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Acquired lock "singleton_lock" {{(pid=76497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 07:18:54 devstack cinder-volume[76497]: DEBUG oslo_concurrency.lockutils [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Releasing lock "singleton_lock" {{(pid=76497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 07:18:54 devstack cinder-volume[76497]: WARNING amqp [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 07:18:54 devstack cinder-volume[76497]: WARNING amqp [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 07:18:54 devstack cinder-volume[76311]: INFO oslo_service.backend._eventlet.service [None req-ab1f6536-a274-4a06-bd03-c5d59490245d None None] Child 76497 exited with status 0 Sep 08 07:18:54 devstack cinder-volume[86484]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 07:18:54 devstack cinder-volume[86484]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 07:18:54 devstack cinder-volume[86484]: we strongly recommend against using it for new projects. Sep 08 07:18:54 devstack cinder-volume[86484]: If you are already using Eventlet, we recommend migrating to a different Sep 08 07:18:54 devstack cinder-volume[86484]: framework. For more detail see Sep 08 07:18:54 devstack cinder-volume[86484]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 07:18:54 devstack cinder-volume[86484]: import eventlet # noqa Sep 08 07:18:56 devstack cinder-volume[86484]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 07:18:56 devstack cinder-volume[86484]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 07:18:56 devstack cinder-volume[86484]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 07:18:57 devstack cinder-volume[86484]: INFO dbcounter [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Registered counter for database cinder Sep 08 07:18:57 devstack cinder-volume[86484]: DEBUG oslo_db.sqlalchemy.engines [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86484) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG dbcounter [-] [86484] Writer thread running {{(pid=86484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 07:18:58 devstack cinder-volume[86484]: INFO cinder.rpc [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 07:18:58 devstack cinder-volume[86484]: INFO cinder.rpc [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_db.sqlalchemy.engines [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86484) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:18:58 devstack cinder-volume[86484]: INFO cinder.volume.manager [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Determined volume DB was empty at startup. Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG cinder.volume.manager [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86484) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 07:18:58 devstack cinder-volume[86484]: INFO cinder.volume.manager [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 07:18:58 devstack cinder-volume[86484]: WARNING stevedore.named [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 07:18:58 devstack cinder-volume[86484]: WARNING castellan.key_manager [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 07:18:58 devstack cinder-volume[86484]: WARNING cinder.keymgr.conf_key_mgr [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 07:18:58 devstack cinder-volume[86484]: INFO cinder.volume.manager [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_db.sqlalchemy.engines [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86484) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:18:58 devstack cinder-volume[86484]: INFO oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Starting 1 workers Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Started child 86698 {{(pid=86484) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Full set of CONF: {{(pid=86484) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] ******************************************************************************** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Configuration options gathered from: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] ================================================================================ {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] allow_availability_zone_fallback = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] allow_compression_on_image_upload = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] allowed_direct_url_schemes = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] api_rate_limit = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] auth_strategy = keystone {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_availability_zone = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_host = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_stats_polling_interval = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backup_api_class = cinder.backup.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backup_name_template = backup-%s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backup_use_same_host = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backup_use_temp_snapshot = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] chap_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] chap_username = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cinder_internal_tenant_project_id = 4e49160bcd8141e8a3f92c989696cc4d {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cinder_internal_tenant_user_id = 4e077e63051f430abf09ef02812a3332 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cluster = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] compression_format = gzip {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] compute_api_class = cinder.compute.nova.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] config_dir = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] config_source = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] control_exchange = openstack {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86698]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] debug = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] default_availability_zone = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] default_group_type = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] default_volume_type = QuobyteHD {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] disk_geometry = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] driver_client_cert = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] driver_client_cert_key = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] driver_data_namespace = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] driver_ssl_cert_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] driver_ssl_cert_verify = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] driver_use_ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] enable_new_services = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] enable_unsupported_driver = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] enabled_backends = ['QuobyteHD'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] enforce_multipath_for_image_xfer = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] filter_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_api_insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_api_servers = ['http://192.168.122.62/image'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_api_ssl_compression = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_ca_certificates_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_catalog_info = image:glance:publicURL {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_num_retries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance_request_timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] goodness_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] graceful_shutdown_timeout = 5 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] group_api_class = cinder.group.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] host = devstack {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_compress_on_upload = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_conversion_address_space_limit = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_conversion_cpu_limit = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_conversion_disable = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_upload_use_cinder_backend = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_upload_use_internal_tenant = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_volume_cache_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_volume_cache_max_count = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] image_volume_cache_max_size_gb = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] init_host_max_objects_retrieval = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] instance_format = [instance: %(uuid)s] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] iscsi_target_flags = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] iscsi_write_cache = on {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] iser_helper = tgtadm {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] iser_ip_address = 192.168.122.62 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] iser_port = 3260 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] log_color = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] log_config_append = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] log_dir = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] log_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] log_options = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] log_rotate_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] log_rotate_interval_type = days {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] log_rotation_type = none {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] max_age = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] max_logfile_count = 30 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] max_logfile_size_mb = 200 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] max_over_subscription_ratio = 20.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] message_reap_interval = 86400 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] message_ttl = 2592000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] migration_create_volume_timeout_secs = 300 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] monkey_patch = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] monkey_patch_modules = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] my_ip = 192.168.122.62 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] no_snapshot_gb_quota = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] num_iser_scan_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] num_shell_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] num_volume_device_scan_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] nvmeof_conn_info_version = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] nvmet_ns_id = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] nvmet_port_id = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] osapi_max_limit = 1000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] osapi_volume_ext_list = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] osapi_volume_listen_port = 8776 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] osapi_volume_use_ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] osapi_volume_workers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] per_volume_size_limit = -1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] periodic_fuzzy_delay = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] periodic_interval = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] public_endpoint = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] publish_errors = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] quota_backup_gigabytes = 1000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] quota_backups = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] quota_gigabytes = 1000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] quota_groups = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] quota_snapshots = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] quota_volumes = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] rate_limit_burst = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] rate_limit_except_level = CRITICAL {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] rate_limit_interval = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] reinit_driver_count = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] replication_device = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] report_discard_supported = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] report_interval = 120 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] reservation_clean_interval = 86400 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] reservation_expire = 86400 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] reserved_image_namespaces = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] reserved_percentage = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] rpc_response_timeout = 120 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] run_external_periodic_tasks = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] scst_target_driver = iscsi {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] scst_target_iqn_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_down_time = 720 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] shell_completion = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] snapshot_name_template = snapshot-%s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] state_path = /opt/stack/data/cinder {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] storage_availability_zone = nova {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] storage_protocol = iSCSI {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] syslog_log_facility = LOG_USER {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] target_helper = lioadm {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] target_ip_address = 192.168.122.62 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] target_port = 3260 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] target_protocol = iscsi {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] target_secondary_ip_addresses = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] trace_flags = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] transport_url = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] until_refresh = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] use_chap_auth = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] use_default_quota_class = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] use_journal = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] use_json = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] use_multipath_for_image_xfer = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] use_stderr = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] use_syslog = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] verify_glance_signatures = enabled {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_api_class = cinder.volume.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_backend_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_clear = zero {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_clear_ionice = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_clear_size = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_copy_bps_limit = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_dd_blocksize = 1M {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_name_template = volume-%s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_service_inithost_offload = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volume_usage_audit_period = month {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] zoning_mode = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_concurrency.disable_process_locking = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 07:18:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86698) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.auth_section = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.auth_type = password {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.auth_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.cache = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.include_service_catalog = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.interface = public {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcache_username = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.region_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.service_type = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.62/identity {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.backend = dogpile.cache.null {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.backend_argument = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.backend_expiration_time = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.config_prefix = cache.oslo {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.debug_cache_backend = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.enable_retry_client = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.enable_socket_keepalive = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.expiration_time = 600 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.hashclient_retry_attempts = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.memcache_dead_retry = 300 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.memcache_pool_maxsize = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.memcache_sasl_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.proxies = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.redis_db = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.redis_server = localhost:6379 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.retry_attempts = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.retry_delay = 0.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.socket_keepalive_count = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.socket_keepalive_idle = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.socket_keepalive_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.socket_timeout = 1.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.tls_allowed_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.tls_cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.tls_certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.tls_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.tls_keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cache.username = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] coordination.backend_url = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.asyncio_connection = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.asyncio_slave_connection = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.backend = sqlalchemy {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.connection = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.connection_debug = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.connection_parameters = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.connection_recycle_time = 3600 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.connection_trace = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.db_inc_retry_interval = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.db_max_retries = 20 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.db_max_retry_interval = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.db_retry_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.max_overflow = 50 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.max_pool_size = 5 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.max_retries = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.mysql_wsrep_sync_wait = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.pool_timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.retry_interval = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.slave_connection = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.sqlite_synchronous = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.synchronous_reader = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] database.use_db_reconnect = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_tracing.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.connection_string = messaging:// {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.es_doc_type = notification {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.es_scroll_size = 10000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.es_scroll_time = 2m {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.filter_error_trace = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.hmac_keys = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.sentinel_service_name = mymaster {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.socket_timeout = 0.1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.trace_requests = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler.trace_sqlalchemy = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler_jaeger.process_tags = {} {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler_jaeger.service_name_prefix = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] profiler_otlp.service_name_prefix = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.enforce_new_defaults = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.policy_default_rule = default {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.policy_file = policy.yaml {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] privsep_osbrick.group = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] privsep_osbrick.helper_command = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] privsep_osbrick.user = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cinder_sys_admin.group = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cinder_sys_admin.helper_command = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] cinder_sys_admin.user = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.auth_section = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.auth_type = password {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.collect_timing = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.send_service_user_token = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.tls_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] service_user.tls_min_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.auth_section = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.auth_type = password {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.collect_timing = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.region_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.tls_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] glance.tls_min_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.backend_availability_zone = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.chap_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.chap_username = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.disk_geometry = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.driver_client_cert = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.driver_client_cert_key = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.driver_data_namespace = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.driver_use_ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.extra_capabilities = {} {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.filter_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.goodness_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.iscsi_target_flags = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.iscsi_write_cache = on {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.iser_helper = tgtadm {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.iser_ip_address = 192.168.122.62 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.iser_port = 3260 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_host = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_login = admin {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86698) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 07:18:58 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 07:18:58 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_mount_options = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_private_key = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_share_path = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Running cmd (subprocess): mount.quobyte {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.num_shell_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.quobyte_volume_url = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.replication_device = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.report_discard_supported = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.reserved_percentage = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.target_helper = tgtadm {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.target_ip_address = 192.168.122.62 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.target_port = 3260 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.target_protocol = iscsi {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.trace_flags = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.unique_fqdn_network = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.use_chap_auth = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.volume_backend_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.volume_clear = zero {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.volume_clear_ionice = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.volume_clear_size = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_reports.file_event_handler = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_reports.log_dir = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.backend_availability_zone = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.backend_host = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.chap_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.chap_username = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.chiscsi_conf = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.disk_geometry = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.driver_client_cert = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.driver_data_namespace = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.driver_use_ssl = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.extra_capabilities = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.filter_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.goodness_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.iser_helper = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.iser_ip_address = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.iser_port = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.iser_target_prefix = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_host = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_login = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_mount_options = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_private_key = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_share_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_ssh_port = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.num_shell_tries = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.nvmet_port_id = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.replication_device = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.report_discard_supported = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.reserved_percentage = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.scst_target_driver = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.storage_protocol = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.target_helper = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.target_ip_address = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.target_port = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.target_prefix = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.target_protocol = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.trace_flags = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.use_chap_auth = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.volume_clear = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.volume_clear_size = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] QuobyteHD.volumes_dir = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack quobyte-client[86701]: Reading configuration file: /etc/quobyte/client.cfg Sep 08 07:18:58 devstack quobyte-client[86701]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] CMD "mount.quobyte" returned: 1 in 0.135s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:18:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86698]: INFO cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 ... Sep 08 07:18:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc -c /etc/quobyte/client-cinder.cfg {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_notifications.driver = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_notifications.retry = -1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] key_manager.fixed_key = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.barbican_api_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.barbican_endpoint = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.barbican_endpoint_type = public {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.barbican_region_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.collect_timing = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.number_of_retries = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.retry_delay = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.send_service_user_token = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.tls_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.tls_min_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.verify_ssl = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican.verify_ssl_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.auth_section = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.auth_type = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.collect_timing = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.tls_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] barbican_service_user.tls_min_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.approle_role_id = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.approle_secret_id = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc -c /etc/quobyte/client-cinder.cfg Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.auth_method = approle {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.auth_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.kv_mountpoint = secret {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.kv_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.kv_version = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.namespace = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.root_token_id = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.ssl_ca_crt_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.timeout = 60.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.token_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.token_role = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.use_ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:18:58 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] ******************************************************************************** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 07:18:59 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.380s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:18:59 devstack cinder-volume[86698]: INFO cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 succeeded Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.394s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:18:59 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:18:59 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:18:59 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.238s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:18:59 devstack cinder-volume[86698]: INFO cinder.volume.driver [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.volume.driver [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.531265258789, 'free_capacity_gb': 1773.531265258789, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86698) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_db.sqlalchemy.engines [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writer thread running {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.db.api [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Building query based on filter {{(pid=86698) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86698) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 07:18:59 devstack cinder-volume[86698]: INFO cinder.keymgr.migration [None req-75f3632d-b6eb-4dc0-a32f-a9f977a7560e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:18:59 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:18:59 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:18:59 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.231s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:18:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Driver initialization completed successfully. Sep 08 07:18:59 devstack cinder-volume[86698]: INFO cinder.manager [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Initiating service 3 cleanup Sep 08 07:18:59 devstack cinder-volume[86698]: INFO cinder.manager [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Service 3 cleanup completed. Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.service [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Creating RPC server for service cinder-volume {{(pid=86698) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.service [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86698) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 07:18:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:18:59 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:18:59 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:19:00 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Sep 08 07:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.262s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:19:00 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-487cf326-4ffb-475d-b3fd-6234067b3f32 None None] Driver post RPC initialization completed successfully. Sep 08 07:19:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-07e8745d-8176-401f-8cc9-2a690d64aebe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:19:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-07e8745d-8176-401f-8cc9-2a690d64aebe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:19:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-07e8745d-8176-401f-8cc9-2a690d64aebe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:19:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-07e8745d-8176-401f-8cc9-2a690d64aebe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:19:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-07e8745d-8176-401f-8cc9-2a690d64aebe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:19:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-07e8745d-8176-401f-8cc9-2a690d64aebe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:19:04 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:19:04 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:19:05 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Sep 08 07:19:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-07e8745d-8176-401f-8cc9-2a690d64aebe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.244s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:19:05 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-07e8745d-8176-401f-8cc9-2a690d64aebe None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:19:05 devstack cinder-volume[86484]: INFO oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Caught SIGTERM, stopping children Sep 08 07:19:05 devstack cinder-volume[86484]: DEBUG oslo_concurrency.lockutils [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Acquiring lock "singleton_lock" {{(pid=86484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 07:19:05 devstack cinder-volume[86484]: DEBUG oslo_concurrency.lockutils [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Acquired lock "singleton_lock" {{(pid=86484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 07:19:05 devstack cinder-volume[86484]: DEBUG oslo_concurrency.lockutils [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Releasing lock "singleton_lock" {{(pid=86484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 07:19:05 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Stop services. {{(pid=86484) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 07:19:05 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Killing children. {{(pid=86484) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 07:19:05 devstack cinder-volume[86484]: INFO oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Waiting on 1 children to exit Sep 08 07:19:05 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-f10280a2-05d5-47a1-b2a5-5b6f9510d474 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f10280a2-05d5-47a1-b2a5-5b6f9510d474 None None] thread count: 6 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f10280a2-05d5-47a1-b2a5-5b6f9510d474 None None] thread info: [<_MainThread(MainThread, started 140505920835712)>, , , , , ] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:19:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Acquiring lock "singleton_lock" {{(pid=86698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 07:19:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Acquired lock "singleton_lock" {{(pid=86698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 07:19:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Releasing lock "singleton_lock" {{(pid=86698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 07:19:08 devstack cinder-volume[86698]: WARNING amqp [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 07:19:08 devstack cinder-volume[86698]: WARNING amqp [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 07:19:08 devstack cinder-volume[86484]: INFO oslo_service.backend._eventlet.service [None req-c33f7bd8-7716-4bb3-a8cb-7f4986001757 None None] Child 86698 exited with status 0 Sep 08 07:19:08 devstack cinder-volume[86983]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 07:19:08 devstack cinder-volume[86983]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 07:19:08 devstack cinder-volume[86983]: we strongly recommend against using it for new projects. Sep 08 07:19:08 devstack cinder-volume[86983]: If you are already using Eventlet, we recommend migrating to a different Sep 08 07:19:08 devstack cinder-volume[86983]: framework. For more detail see Sep 08 07:19:08 devstack cinder-volume[86983]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 07:19:08 devstack cinder-volume[86983]: import eventlet # noqa Sep 08 07:19:11 devstack cinder-volume[86983]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 07:19:11 devstack cinder-volume[86983]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 07:19:11 devstack cinder-volume[86983]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 07:19:12 devstack cinder-volume[86983]: INFO dbcounter [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Registered counter for database cinder Sep 08 07:19:12 devstack cinder-volume[86983]: DEBUG oslo_db.sqlalchemy.engines [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:19:12 devstack cinder-volume[86983]: DEBUG dbcounter [-] [86983] Writer thread running {{(pid=86983) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 07:19:12 devstack cinder-volume[86983]: INFO cinder.rpc [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 07:19:12 devstack cinder-volume[86983]: INFO cinder.rpc [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 07:19:12 devstack cinder-volume[86983]: DEBUG oslo_db.sqlalchemy.engines [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:19:13 devstack cinder-volume[86983]: INFO cinder.volume.manager [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Determined volume DB was empty at startup. Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG cinder.volume.manager [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86983) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 07:19:13 devstack cinder-volume[86983]: WARNING stevedore.named [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 07:19:13 devstack cinder-volume[86983]: WARNING castellan.key_manager [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 07:19:13 devstack cinder-volume[86983]: WARNING cinder.keymgr.conf_key_mgr [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 07:19:13 devstack cinder-volume[86983]: INFO cinder.volume.manager [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_db.sqlalchemy.engines [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:19:13 devstack cinder-volume[86983]: INFO oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Starting 1 workers Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Started child 87278 {{(pid=86983) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Full set of CONF: {{(pid=86983) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] ******************************************************************************** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] Configuration options gathered from: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] ================================================================================ {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] allow_availability_zone_fallback = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] allow_compression_on_image_upload = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] allowed_direct_url_schemes = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] api_rate_limit = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] auth_strategy = keystone {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_availability_zone = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_host = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_stats_polling_interval = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backup_api_class = cinder.backup.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backup_name_template = backup-%s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backup_use_same_host = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backup_use_temp_snapshot = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] chap_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] chap_username = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cinder_internal_tenant_project_id = 4e49160bcd8141e8a3f92c989696cc4d {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cinder_internal_tenant_user_id = 4e077e63051f430abf09ef02812a3332 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cluster = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] compression_format = gzip {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] compute_api_class = cinder.compute.nova.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] config_dir = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] config_source = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] control_exchange = openstack {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[87278]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] debug = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] default_availability_zone = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] default_group_type = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] default_volume_type = QuobyteHD {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] disk_geometry = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] driver_client_cert = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] driver_client_cert_key = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] driver_data_namespace = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] driver_ssl_cert_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] driver_ssl_cert_verify = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] driver_use_ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] enable_new_services = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] enable_unsupported_driver = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] enabled_backends = ['QuobyteHD'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] enforce_multipath_for_image_xfer = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] filter_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_api_insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_api_servers = ['http://192.168.122.62/image'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_api_ssl_compression = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_ca_certificates_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_catalog_info = image:glance:publicURL {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_num_retries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance_request_timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] goodness_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] graceful_shutdown_timeout = 5 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] group_api_class = cinder.group.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] host = devstack {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_compress_on_upload = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_conversion_address_space_limit = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_conversion_cpu_limit = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_conversion_disable = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_upload_use_cinder_backend = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_upload_use_internal_tenant = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_volume_cache_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_volume_cache_max_count = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] image_volume_cache_max_size_gb = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] init_host_max_objects_retrieval = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] instance_format = [instance: %(uuid)s] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] iscsi_target_flags = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] iscsi_write_cache = on {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] iser_helper = tgtadm {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] iser_ip_address = 192.168.122.62 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] iser_port = 3260 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] log_color = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] log_config_append = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] log_dir = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] log_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] log_options = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] log_rotate_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] log_rotate_interval_type = days {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] log_rotation_type = none {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] max_age = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] max_logfile_count = 30 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] max_logfile_size_mb = 200 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] max_over_subscription_ratio = 20.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] message_reap_interval = 86400 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] message_ttl = 2592000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] migration_create_volume_timeout_secs = 300 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] monkey_patch = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] monkey_patch_modules = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] my_ip = 192.168.122.62 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] no_snapshot_gb_quota = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] num_iser_scan_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] num_shell_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] num_volume_device_scan_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] nvmeof_conn_info_version = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] nvmet_ns_id = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] nvmet_port_id = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] osapi_max_limit = 1000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] osapi_volume_ext_list = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] osapi_volume_listen_port = 8776 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] osapi_volume_use_ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] osapi_volume_workers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] per_volume_size_limit = -1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] periodic_fuzzy_delay = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] periodic_interval = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] public_endpoint = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] publish_errors = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] quota_backup_gigabytes = 1000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] quota_backups = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] quota_gigabytes = 1000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] quota_groups = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] quota_snapshots = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] quota_volumes = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] rate_limit_burst = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] rate_limit_except_level = CRITICAL {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] rate_limit_interval = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] reinit_driver_count = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] replication_device = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] report_discard_supported = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] report_interval = 120 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] reservation_clean_interval = 86400 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] reservation_expire = 86400 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] reserved_image_namespaces = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] reserved_percentage = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] rpc_response_timeout = 120 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] run_external_periodic_tasks = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] scst_target_driver = iscsi {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] scst_target_iqn_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_down_time = 720 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] shell_completion = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] snapshot_name_template = snapshot-%s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] state_path = /opt/stack/data/cinder {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] storage_availability_zone = nova {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] storage_protocol = iSCSI {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] syslog_log_facility = LOG_USER {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] target_helper = lioadm {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] target_ip_address = 192.168.122.62 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] target_port = 3260 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] target_protocol = iscsi {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] target_secondary_ip_addresses = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] trace_flags = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] transport_url = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] until_refresh = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] use_chap_auth = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] use_default_quota_class = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] use_journal = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] use_json = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87278) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] use_multipath_for_image_xfer = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] use_stderr = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] use_syslog = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] verify_glance_signatures = enabled {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_api_class = cinder.volume.api.API {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_backend_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_clear = zero {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_clear_ionice = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_clear_size = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_copy_bps_limit = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_dd_blocksize = 1M {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_name_template = volume-%s {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_service_inithost_offload = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volume_usage_audit_period = month {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] zoning_mode = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_concurrency.disable_process_locking = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.auth_section = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.auth_type = password {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.auth_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.cache = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.include_service_catalog = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.interface = public {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcache_username = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.region_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.service_type = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.62/identity {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.backend = dogpile.cache.null {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.backend_argument = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.backend_expiration_time = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.config_prefix = cache.oslo {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.debug_cache_backend = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.enable_retry_client = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.enable_socket_keepalive = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.expiration_time = 600 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.hashclient_retry_attempts = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.memcache_dead_retry = 300 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.memcache_pool_maxsize = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.memcache_sasl_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.proxies = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.redis_db = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.redis_server = localhost:6379 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.retry_attempts = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.retry_delay = 0.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.socket_keepalive_count = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.socket_keepalive_idle = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.socket_keepalive_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.socket_timeout = 1.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.tls_allowed_ciphers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.tls_cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.tls_certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.tls_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.tls_keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cache.username = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] coordination.backend_url = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.asyncio_connection = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.asyncio_slave_connection = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.backend = sqlalchemy {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.connection = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.connection_debug = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.connection_parameters = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.connection_recycle_time = 3600 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.connection_trace = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.db_inc_retry_interval = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.db_max_retries = 20 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.db_max_retry_interval = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.db_retry_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.max_overflow = 50 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.max_pool_size = 5 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.max_retries = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.mysql_wsrep_sync_wait = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.pool_timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.retry_interval = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.slave_connection = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.sqlite_synchronous = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.synchronous_reader = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] database.use_db_reconnect = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_tracing.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.connection_string = messaging:// {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.es_doc_type = notification {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.es_scroll_size = 10000 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.es_scroll_time = 2m {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.filter_error_trace = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.hmac_keys = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.sentinel_service_name = mymaster {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.socket_timeout = 0.1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.trace_requests = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler.trace_sqlalchemy = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler_jaeger.process_tags = {} {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler_jaeger.service_name_prefix = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] profiler_otlp.service_name_prefix = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.enforce_new_defaults = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.policy_default_rule = default {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.policy_file = policy.yaml {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] privsep_osbrick.group = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] privsep_osbrick.helper_command = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] privsep_osbrick.user = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cinder_sys_admin.group = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cinder_sys_admin.helper_command = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] cinder_sys_admin.user = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.auth_section = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.auth_type = password {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.collect_timing = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.send_service_user_token = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.tls_ciphers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] service_user.tls_min_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.auth_section = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.auth_type = password {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.collect_timing = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.region_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.tls_ciphers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] glance.tls_min_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.backend_availability_zone = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.chap_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.chap_username = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.disk_geometry = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.driver_client_cert = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.driver_client_cert_key = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.driver_data_namespace = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.driver_use_ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.extra_capabilities = {} {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.filter_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.goodness_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.iscsi_target_flags = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.iscsi_write_cache = on {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.iser_helper = tgtadm {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.iser_ip_address = 192.168.122.62 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.iser_port = 3260 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_host = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_login = admin {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_mount_options = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_private_key = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87278) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_share_path = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.quobyte [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.num_shell_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.quobyte_volume_url = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.replication_device = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.report_discard_supported = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.reserved_percentage = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.quobyte [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.target_helper = tgtadm {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.target_ip_address = 192.168.122.62 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.target_port = 3260 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.target_protocol = iscsi {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Running cmd (subprocess): mount.quobyte {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.trace_flags = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.unique_fqdn_network = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.use_chap_auth = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.volume_backend_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.volume_clear = zero {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.volume_clear_ionice = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.volume_clear_size = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_reports.file_event_handler = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_reports.log_dir = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.backend_availability_zone = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.backend_host = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.chap_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.chap_username = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.chiscsi_conf = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.disk_geometry = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.driver_client_cert = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.driver_data_namespace = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.driver_use_ssl = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.extra_capabilities = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.filter_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.goodness_function = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.iser_helper = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.iser_ip_address = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.iser_port = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.iser_target_prefix = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_host = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_login = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_mount_options = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_password = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_private_key = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_share_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_ssh_port = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.num_shell_tries = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.nvmet_port_id = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.replication_device = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.report_discard_supported = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.reserved_percentage = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.scst_target_driver = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.storage_protocol = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.target_helper = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.target_ip_address = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.target_port = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.target_prefix = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.target_protocol = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.trace_flags = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.use_chap_auth = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.volume_clear = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.volume_clear_size = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] QuobyteHD.volumes_dir = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_notifications.driver = [] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_notifications.retry = -1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] key_manager.fixed_key = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.barbican_api_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.barbican_endpoint = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.barbican_endpoint_type = public {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.barbican_region_name = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.collect_timing = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.number_of_retries = 60 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.retry_delay = 1 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.send_service_user_token = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.tls_ciphers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.tls_min_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.verify_ssl = True {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican.verify_ssl_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.auth_section = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.auth_type = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack quobyte-client[87280]: Reading configuration file: /etc/quobyte/client.cfg Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.cafile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.certfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.collect_timing = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.insecure = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.keyfile = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack quobyte-client[87280]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.split_loggers = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.timeout = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.tls_ciphers = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] barbican_service_user.tls_min_version = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.approle_role_id = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.approle_secret_id = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.auth_method = approle {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.auth_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.kv_mountpoint = secret {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.kv_path = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.kv_version = 2 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.namespace = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.root_token_id = **** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.ssl_ca_crt_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.timeout = 60.0 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.token_file = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.token_role = None {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.use_ssl = False {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 07:19:13 devstack cinder-volume[86983]: DEBUG oslo_service.backend._eventlet.service [None req-7f68318b-df8e-421b-a573-941cb0858393 None None] ******************************************************************************** {{(pid=86983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:19:13 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:19:13 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:19:13 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.316s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:19:13 devstack cinder-volume[87278]: INFO cinder.volume.driver [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG cinder.volume.driver [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.531265258789, 'free_capacity_gb': 1773.531265258789, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87278) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writer thread running {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG cinder.db.api [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Building query based on filter {{(pid=87278) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87278) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:19:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:19:13 devstack cinder-volume[87278]: INFO cinder.keymgr.migration [None req-9ea4a7a1-2387-45bd-a4bc-552d87b0c146 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 07:19:13 devstack sudo[87303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:19:13 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:19:14 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.233s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:19:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Driver initialization completed successfully. Sep 08 07:19:14 devstack cinder-volume[87278]: INFO cinder.manager [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Initiating service 3 cleanup Sep 08 07:19:14 devstack cinder-volume[87278]: INFO cinder.manager [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Service 3 cleanup completed. Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG cinder.service [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Creating RPC server for service cinder-volume {{(pid=87278) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG cinder.service [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87278) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 07:19:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:19:14 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:19:14 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:19:14 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Sep 08 07:19:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.233s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:19:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e7a953cc-b751-4872-83a4-41a8f5dd5de5 None None] Driver post RPC initialization completed successfully. Sep 08 07:19:23 devstack cinder-volume[86983]: DEBUG dbcounter [-] [86983] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86983) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:19:24 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:19:24 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:19:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:19:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 6 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:19:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Flow 'volume_create_manager' (3870e2b2-3228-4a2c-b039-18f592054f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aee9e38-84f6-4d79-b41e-77a2c6182514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aee9e38-84f6-4d79-b41e-77a2c6182514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2137334640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca9600b7-326e-42a8-9bac-67d149d47727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a504028de541f2aea614fbbfb6b64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:20:14Z,use_quota=True,user_id='4ef679e0d012403e946af0151adc8c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad88a48e-8e47-4baf-8ab5-2fa4ca78a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad88a48e-8e47-4baf-8ab5-2fa4ca78a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f45fd0-baaa-442a-a36e-2bd1554a6649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f45fd0-baaa-442a-a36e-2bd1554a6649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca9600b7-326e-42a8-9bac-67d149d47727', 'volume_name': 'volume-ca9600b7-326e-42a8-9bac-67d149d47727', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bf513a-e6ab-41e4-95bd-1ab74fb867cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bf513a-e6ab-41e4-95bd-1ab74fb867cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765ff4f5-0a37-4579-b5c7-8e06c908d991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:13 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Volume ca9600b7-326e-42a8-9bac-67d149d47727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca9600b7-326e-42a8-9bac-67d149d47727', 'volume_size': 1} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2137334640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca9600b7-326e-42a8-9bac-67d149d47727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a504028de541f2aea614fbbfb6b64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:20:14Z,use_quota=True,user_id='4ef679e0d012403e946af0151adc8c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Creating volume ca9600b7-326e-42a8-9bac-67d149d47727 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:20:13 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:20:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:20:14 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727 1073741824 Sep 08 07:20:14 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:20:14 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Sep 08 07:20:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727 1073741824" returned: 0 in 0.587s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:20:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:20:14 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727 Sep 08 07:20:14 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:20:14 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Sep 08 07:20:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727" returned: 0 in 0.314s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:20:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:20:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:20:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765ff4f5-0a37-4579-b5c7-8e06c908d991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca9600b7-326e-42a8-9bac-67d149d47727', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b862eb91-bb11-41d7-b797-7892bb0992b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Volume volume-ca9600b7-326e-42a8-9bac-67d149d47727 (ca9600b7-326e-42a8-9bac-67d149d47727): created successfully Sep 08 07:20:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b862eb91-bb11-41d7-b797-7892bb0992b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Flow 'volume_create_manager' (3870e2b2-3228-4a2c-b039-18f592054f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:20:15 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-198e7907-7332-46a0-85cc-1f1e21eb8d7a tempest-TaggedAttachmentsTest-1847778376 None] Created volume successfully. Sep 08 07:20:25 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:20:25 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:20:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:20:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:20:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:20:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:20:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:20:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:20:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:20:44 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:20:44 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:20:45 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Sep 08 07:20:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:20:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:20:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:20:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 6 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:20:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Flow 'volume_create_manager' (87205055-d266-466e-94be-778bdf747603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5121a8-377b-4f81-aac4-39ee7ca87099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5121a8-377b-4f81-aac4-39ee7ca87099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-193302672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829627b8-46e4-49cb-a212-7e393e2d19c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca379adfa39d48799e947a7a313b6f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:20:47Z,use_quota=True,user_id='9ca092ef353642bcab48fa8ed74168b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0c312e-0395-40ee-a3f9-fe5d9488a946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0c312e-0395-40ee-a3f9-fe5d9488a946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6d0564-5290-4d15-ba13-9724adf59cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6d0564-5290-4d15-ba13-9724adf59cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829627b8-46e4-49cb-a212-7e393e2d19c5', 'volume_name': 'volume-829627b8-46e4-49cb-a212-7e393e2d19c5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1503cc55-3cda-49de-abd4-88965067c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1503cc55-3cda-49de-abd4-88965067c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b353641-7026-432e-bbca-88a0ffe1d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:47 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Volume 829627b8-46e4-49cb-a212-7e393e2d19c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829627b8-46e4-49cb-a212-7e393e2d19c5', 'volume_size': 1} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-193302672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829627b8-46e4-49cb-a212-7e393e2d19c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca379adfa39d48799e947a7a313b6f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:20:47Z,use_quota=True,user_id='9ca092ef353642bcab48fa8ed74168b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Creating volume 829627b8-46e4-49cb-a212-7e393e2d19c5 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:20:47 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:20:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:20:47 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5 1073741824 Sep 08 07:20:47 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:20:48 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Sep 08 07:20:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5 1073741824" returned: 0 in 0.755s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:20:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:20:48 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5 Sep 08 07:20:48 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:20:49 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Sep 08 07:20:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5" returned: 0 in 0.400s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:20:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:20:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:20:49 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b353641-7026-432e-bbca-88a0ffe1d396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829627b8-46e4-49cb-a212-7e393e2d19c5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:49 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45180b3a-7df3-4ca3-8754-947308e47409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:49 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Volume volume-829627b8-46e4-49cb-a212-7e393e2d19c5 (829627b8-46e4-49cb-a212-7e393e2d19c5): created successfully Sep 08 07:20:49 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45180b3a-7df3-4ca3-8754-947308e47409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:49 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Flow 'volume_create_manager' (87205055-d266-466e-94be-778bdf747603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:20:49 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1de206e9-1b5b-466c-9f7f-33317390f8c4 tempest-AttachVolumeShelveTestJSON-362691567 None] Created volume successfully. Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Flow 'volume_create_manager' (a17dfdcd-3436-40ba-b91d-2e9968191f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab9788f-ffa5-4a46-8d89-a04340d03589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab9788f-ffa5-4a46-8d89-a04340d03589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-944112745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addda4a8-f32c-448d-b778-e4e960182109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ffa19a64af48b4a47334dc1f0ce407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:20:51Z,use_quota=True,user_id='433dd44870794b0f903ed89fa2b33c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d120097-f593-4bf3-a462-49a57e825b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d120097-f593-4bf3-a462-49a57e825b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76444e33-0f0e-466b-867d-2b78350fa132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76444e33-0f0e-466b-867d-2b78350fa132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'addda4a8-f32c-448d-b778-e4e960182109', 'volume_name': 'volume-addda4a8-f32c-448d-b778-e4e960182109', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f938e9-89c0-4155-8ef8-eff8245daced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f938e9-89c0-4155-8ef8-eff8245daced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfc6e09-c8ae-4e69-a232-1e88364c4e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:50 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Volume addda4a8-f32c-448d-b778-e4e960182109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-addda4a8-f32c-448d-b778-e4e960182109', 'volume_size': 1} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-944112745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addda4a8-f32c-448d-b778-e4e960182109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ffa19a64af48b4a47334dc1f0ce407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:20:51Z,use_quota=True,user_id='433dd44870794b0f903ed89fa2b33c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Creating volume addda4a8-f32c-448d-b778-e4e960182109 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:20:50 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:20:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:20:50 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109 1073741824 Sep 08 07:20:50 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:20:51 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Sep 08 07:20:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109 1073741824" returned: 0 in 0.852s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:20:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:20:51 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109 Sep 08 07:20:51 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:20:52 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Sep 08 07:20:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109" returned: 0 in 0.538s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:20:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:20:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:20:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfc6e09-c8ae-4e69-a232-1e88364c4e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-addda4a8-f32c-448d-b778-e4e960182109', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f893f51e-58a5-4943-84f3-58f358cc7d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:20:52 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Volume volume-addda4a8-f32c-448d-b778-e4e960182109 (addda4a8-f32c-448d-b778-e4e960182109): created successfully Sep 08 07:20:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f893f51e-58a5-4943-84f3-58f358cc7d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:20:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Flow 'volume_create_manager' (a17dfdcd-3436-40ba-b91d-2e9968191f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:20:52 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ab2c9ddb-5ddb-4ccb-a2db-655539bc40ce tempest-ServerActionsTestOtherA-1193629056 None] Created volume successfully. Sep 08 07:21:02 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:21:02 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:21:10 devstack cinder-volume[87278]: WARNING py.warnings [req-0ccbe371-2202-4b7e-9e67-6173fe1aaccf req-67a0bc5b-e48c-47d8-979f-6d11f81b4660 tempest-AttachVolumeShelveTestJSON-362691567 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 08 07:21:10 devstack cinder-volume[87278]: .first() Sep 08 07:21:10 devstack cinder-volume[87278]: Sep 08 07:21:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-0ccbe371-2202-4b7e-9e67-6173fe1aaccf req-67a0bc5b-e48c-47d8-979f-6d11f81b4660 tempest-AttachVolumeShelveTestJSON-362691567 None] No connector for attachment f96e9e1a-2dc2-409e-bccf-1bb7ea42d94b; skipping storage backend terminate_connection call. {{(pid=87278) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 08 07:21:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-0ccbe371-2202-4b7e-9e67-6173fe1aaccf req-67a0bc5b-e48c-47d8-979f-6d11f81b4660 tempest-AttachVolumeShelveTestJSON-362691567 None] Deleting attachment f96e9e1a-2dc2-409e-bccf-1bb7ea42d94b. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:21:20 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:21:24 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:21:28 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Flow 'volume_create_manager' (74c4f8da-2e93-4c36-b082-a5963611d7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bc667a-a023-4a47-bee7-7b425030a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bc667a-a023-4a47-bee7-7b425030a46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1126710020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0baedcc0-c457-45da-bc99-b7207f8ed259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9416d824753a413fab34df0774dc0d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:21:29Z,use_quota=True,user_id='3a717d670f4648b2aa52a531d5d7c010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6163b9f4-3f67-43f6-90fc-be5a9dad5584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6163b9f4-3f67-43f6-90fc-be5a9dad5584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f6a124-ddf6-4b26-8076-138955d3d49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f6a124-ddf6-4b26-8076-138955d3d49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0baedcc0-c457-45da-bc99-b7207f8ed259', 'volume_name': 'volume-0baedcc0-c457-45da-bc99-b7207f8ed259', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a96c563-3ccb-45cb-a5bf-936bb084b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a96c563-3ccb-45cb-a5bf-936bb084b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad998c1-5c6e-45f7-b50e-4d79e0f8239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:21:29 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Volume 0baedcc0-c457-45da-bc99-b7207f8ed259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0baedcc0-c457-45da-bc99-b7207f8ed259', 'volume_size': 1} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1126710020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0baedcc0-c457-45da-bc99-b7207f8ed259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9416d824753a413fab34df0774dc0d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:21:29Z,use_quota=True,user_id='3a717d670f4648b2aa52a531d5d7c010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Creating volume 0baedcc0-c457-45da-bc99-b7207f8ed259 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:21:29 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:21:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:21:29 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259 1073741824 Sep 08 07:21:29 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:30 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259 1073741824" returned: 0 in 0.984s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:21:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:21:30 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259 Sep 08 07:21:30 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:30 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259" returned: 0 in 0.599s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:21:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:21:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:21:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad998c1-5c6e-45f7-b50e-4d79e0f8239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0baedcc0-c457-45da-bc99-b7207f8ed259', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:21:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87010b5e-c8b0-46a3-afa2-fe170b55fde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:21:30 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Volume volume-0baedcc0-c457-45da-bc99-b7207f8ed259 (0baedcc0-c457-45da-bc99-b7207f8ed259): created successfully Sep 08 07:21:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87010b5e-c8b0-46a3-afa2-fe170b55fde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:21:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Flow 'volume_create_manager' (74c4f8da-2e93-4c36-b082-a5963611d7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:21:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c5b81248-210c-4863-aa8e-c73f9be140ba tempest-VolumesAdminNegativeTest-2048253703 None] Created volume successfully. Sep 08 07:21:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-8ce59f64-c37a-4ebd-9ac9-30567e813905 req-8dc18afd-e219-4a01-9035-3c2a32e353c8 tempest-TaggedAttachmentsTest-1847778376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:21:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-8ce59f64-c37a-4ebd-9ac9-30567e813905 req-8dc18afd-e219-4a01-9035-3c2a32e353c8 tempest-TaggedAttachmentsTest-1847778376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:21:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-8ce59f64-c37a-4ebd-9ac9-30567e813905 req-8dc18afd-e219-4a01-9035-3c2a32e353c8 tempest-TaggedAttachmentsTest-1847778376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:21:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-8ce59f64-c37a-4ebd-9ac9-30567e813905 req-8dc18afd-e219-4a01-9035-3c2a32e353c8 tempest-TaggedAttachmentsTest-1847778376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-ca9600b7-326e-42a8-9bac-67d149d47727', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25b25386-3c5c-4ebf-be9c-6e67b7cbacbc', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:21:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-8ce59f64-c37a-4ebd-9ac9-30567e813905 req-8dc18afd-e219-4a01-9035-3c2a32e353c8 tempest-TaggedAttachmentsTest-1847778376 None] attachment_update completed successfully. Sep 08 07:21:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Acquiring lock "cinder-0baedcc0-c457-45da-bc99-b7207f8ed259-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:21:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Lock "cinder-0baedcc0-c457-45da-bc99-b7207f8ed259-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:21:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Acquiring lock "cinder-quobyte-0baedcc0-c457-45da-bc99-b7207f8ed259" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:21:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Lock "cinder-quobyte-0baedcc0-c457-45da-bc99-b7207f8ed259" acquired by "delete_volume" :: waited 0.052s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:21:31 devstack cinder-volume[87278]: INFO oslo.privsep.daemon [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpauefq67e/privsep.sock'] Sep 08 07:21:31 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpauefq67e/privsep.sock Sep 08 07:21:31 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:33 devstack cinder-volume[87278]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 08 07:21:33 devstack cinder-volume[87278]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 07:21:33 devstack cinder-volume[87278]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 08 07:21:33 devstack cinder-volume[87278]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 07:21:33 devstack cinder-volume[87278]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 08 07:21:33 devstack cinder-volume[87278]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 08 07:21:33 devstack cinder-volume[87278]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 07:21:33 devstack cinder-volume[87278]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 07:21:33 devstack cinder-volume[87278]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 08 07:21:33 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:33 devstack cinder-volume[87278]: INFO oslo.privsep.daemon [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Spawned new privsep daemon via rootwrap Sep 08 07:21:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Accepted privsep connection to /tmp/tmpauefq67e/privsep.sock {{(pid=87278) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 08 07:21:33 devstack cinder-volume[87278]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 08 07:21:33 devstack cinder-volume[87278]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 08 07:21:33 devstack cinder-volume[87278]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 08 07:21:33 devstack cinder-volume[87278]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89460 Sep 08 07:21:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e35e341-6520-4702-950d-6177fc692c1a]: (2,) {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:21:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1caad01-1baf-4ab4-acce-40e989edff56]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:21:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:21:33 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259 Sep 08 07:21:33 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:33 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259" returned: 0 in 0.504s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:21:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:21:33 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259 Sep 08 07:21:33 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:34 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0baedcc0-c457-45da-bc99-b7207f8ed259" returned: 0 in 0.445s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:21:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Lock "cinder-quobyte-0baedcc0-c457-45da-bc99-b7207f8ed259" released by "delete_volume" :: held 2.494s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:21:34 devstack cinder-volume[87278]: WARNING cinder.quota [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:21:34 devstack cinder-volume[87278]: WARNING cinder.quota [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:21:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Created reservations ['a05d70a5-f4f7-460c-a445-97609f8f62ac', '1921091f-71eb-4db5-ab0f-70542ee57b1d', '0562e10a-3859-4f0a-9bed-7293d8ac6fd1', '60072120-76f8-4b6c-a1fa-c08b2afe389d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:21:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:21:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:21:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:21:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:21:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:21:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:21:34 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:21:34 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:35 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.706s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:21:35 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:21:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Deleted volume successfully. Sep 08 07:21:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-000565fd-076d-4a31-977a-534bb62355d7 tempest-VolumesAdminNegativeTest-2048253703 None] Lock "cinder-0baedcc0-c457-45da-bc99-b7207f8ed259-delete_volume" released by "delete_volume" :: held 3.789s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:21:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-7dcfc0a3-c895-4234-b119-95b56423f244 req-d09c06c4-9905-4848-8154-e7d8ed1e8b64 tempest-TaggedAttachmentsTest-1847778376 None] Terminate volume connection completed successfully. Sep 08 07:21:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-7dcfc0a3-c895-4234-b119-95b56423f244 req-d09c06c4-9905-4848-8154-e7d8ed1e8b64 tempest-TaggedAttachmentsTest-1847778376 None] Deleting attachment 25b25386-3c5c-4ebf-be9c-6e67b7cbacbc. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:21:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-daa283e0-4f86-45f7-af0c-2d15845e6a0a req-deaa5516-4363-476e-bc3f-6c463e6a2dec tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:21:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-daa283e0-4f86-45f7-af0c-2d15845e6a0a req-deaa5516-4363-476e-bc3f-6c463e6a2dec tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:21:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-daa283e0-4f86-45f7-af0c-2d15845e6a0a req-deaa5516-4363-476e-bc3f-6c463e6a2dec tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:21:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-daa283e0-4f86-45f7-af0c-2d15845e6a0a req-deaa5516-4363-476e-bc3f-6c463e6a2dec tempest-ServerActionsTestOtherA-1193629056 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-addda4a8-f32c-448d-b778-e4e960182109', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '236b41d4-ba02-4b23-8eae-db0382fcca13', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:21:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-daa283e0-4f86-45f7-af0c-2d15845e6a0a req-deaa5516-4363-476e-bc3f-6c463e6a2dec tempest-ServerActionsTestOtherA-1193629056 None] attachment_update completed successfully. Sep 08 07:21:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-bd6dcb8e-28d2-4dfb-9441-fe4e325284f4 req-d0d5ed7b-2a77-4e63-baf0-633aa870a672 tempest-ServerActionsTestOtherA-1193629056 None] Terminate volume connection completed successfully. Sep 08 07:21:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-bd6dcb8e-28d2-4dfb-9441-fe4e325284f4 req-d0d5ed7b-2a77-4e63-baf0-633aa870a672 tempest-ServerActionsTestOtherA-1193629056 None] Deleting attachment 236b41d4-ba02-4b23-8eae-db0382fcca13. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:21:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-bd6dcb8e-28d2-4dfb-9441-fe4e325284f4 req-0f35f709-773a-431c-91d3-f3134f6c15ea tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:21:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-bd6dcb8e-28d2-4dfb-9441-fe4e325284f4 req-0f35f709-773a-431c-91d3-f3134f6c15ea tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:21:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-bd6dcb8e-28d2-4dfb-9441-fe4e325284f4 req-0f35f709-773a-431c-91d3-f3134f6c15ea tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:21:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-bd6dcb8e-28d2-4dfb-9441-fe4e325284f4 req-0f35f709-773a-431c-91d3-f3134f6c15ea tempest-ServerActionsTestOtherA-1193629056 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-addda4a8-f32c-448d-b778-e4e960182109', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2e8740c-1429-4336-a86e-0b4c37936b69', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:21:43 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-bd6dcb8e-28d2-4dfb-9441-fe4e325284f4 req-0f35f709-773a-431c-91d3-f3134f6c15ea tempest-ServerActionsTestOtherA-1193629056 None] attachment_update completed successfully. Sep 08 07:21:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:21:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:21:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:21:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:21:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:21:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:21:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:21:44 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:21:44 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:44 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.384s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:21:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:21:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Acquiring lock "cinder-ca9600b7-326e-42a8-9bac-67d149d47727-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:21:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Lock "cinder-ca9600b7-326e-42a8-9bac-67d149d47727-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:21:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Acquiring lock "cinder-quobyte-ca9600b7-326e-42a8-9bac-67d149d47727" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:21:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Lock "cinder-quobyte-ca9600b7-326e-42a8-9bac-67d149d47727" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:21:49 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92cb1cf-1206-416b-87ac-69844253e793]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:21:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:21:49 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727 Sep 08 07:21:49 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:49 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727" returned: 0 in 0.395s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:21:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:21:49 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727 Sep 08 07:21:49 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:50 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca9600b7-326e-42a8-9bac-67d149d47727" returned: 0 in 0.339s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Lock "cinder-quobyte-ca9600b7-326e-42a8-9bac-67d149d47727" released by "delete_volume" :: held 0.804s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Created reservations ['44295a51-5d11-4f9e-b37e-efedaa4bcbc6', '78c789a8-aa02-42b2-b09f-3129a9f102ab', 'f229bd14-7126-418d-90cf-8f27de809d3b', '2a2ce4fb-c773-4f6a-a779-0be3b867dbed'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:21:50 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:21:50 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:21:50 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.327s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:21:50 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Deleted volume successfully. Sep 08 07:21:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6629e9c0-011c-4231-9cfe-1fe5188ae393 tempest-TaggedAttachmentsTest-1847778376 None] Lock "cinder-ca9600b7-326e-42a8-9bac-67d149d47727-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:22:00 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=34,cinder:UPDATE=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:22:00 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=33,cinder:UPDATE=34,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:22:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Acquiring lock "cinder-829627b8-46e4-49cb-a212-7e393e2d19c5-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:22:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "cinder-829627b8-46e4-49cb-a212-7e393e2d19c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:22:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Acquiring lock "cinder-quobyte-829627b8-46e4-49cb-a212-7e393e2d19c5" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:22:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "cinder-quobyte-829627b8-46e4-49cb-a212-7e393e2d19c5" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:22:01 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[99320cba-6370-43df-833d-4511a60e8be7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:01 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5 Sep 08 07:22:01 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:01 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5" returned: 0 in 0.391s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:01 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5 Sep 08 07:22:01 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:02 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-829627b8-46e4-49cb-a212-7e393e2d19c5" returned: 0 in 0.353s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "cinder-quobyte-829627b8-46e4-49cb-a212-7e393e2d19c5" released by "delete_volume" :: held 0.793s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Created reservations ['1cd41017-98a7-4ac0-b97e-62cd01c2a5ac', '8b4e107c-8f10-42a5-b748-0510ff7c8363', '919ae33d-0ef9-45cd-a4fb-eec9e2ff6a72', '475dc006-270e-4759-af97-9e5d0cb851e6'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:02 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:22:02 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:02 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.301s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:22:02 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Deleted volume successfully. Sep 08 07:22:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8cf24bbb-a78d-439d-a58c-16d0adeec2cb tempest-AttachVolumeShelveTestJSON-362691567 None] Lock "cinder-829627b8-46e4-49cb-a212-7e393e2d19c5-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:22:12 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=5,cinder:SELECT=5,cinder:INSERT=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:22:12 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:22:16 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-a32500cc-dd27-497f-89f6-b99afebdb46a req-80a66470-173e-401c-aa32-af6e1feca130 tempest-ServerActionsTestOtherA-1193629056 None] Terminate volume connection completed successfully. Sep 08 07:22:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-a32500cc-dd27-497f-89f6-b99afebdb46a req-80a66470-173e-401c-aa32-af6e1feca130 tempest-ServerActionsTestOtherA-1193629056 None] Deleting attachment e2e8740c-1429-4336-a86e-0b4c37936b69. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:22:26 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=2 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:22:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7bafe0f0-c22c-4017-bac5-b4e799fb5eca tempest-GroupSnapshotsV319Test-1941228446 None] Group tempest-GroupSnapshotsV319Test-Group-421866190: creating Sep 08 07:22:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7bafe0f0-c22c-4017-bac5-b4e799fb5eca tempest-GroupSnapshotsV319Test-1941228446 None] Group tempest-GroupSnapshotsV319Test-Group-421866190: created successfully Sep 08 07:22:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7bafe0f0-c22c-4017-bac5-b4e799fb5eca tempest-GroupSnapshotsV319Test-1941228446 None] Create group completed successfully. Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Flow 'volume_create_manager' (c21d14eb-89be-4793-9995-db422e61be24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9524d3e1-f35f-4c7a-b549-bb8298835fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9524d3e1-f35f-4c7a-b549-bb8298835fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-929210678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5465ae4-3158-40a1-99bc-0f8c0d4ca376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ffa19a64af48b4a47334dc1f0ce407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:22:28Z,use_quota=True,user_id='433dd44870794b0f903ed89fa2b33c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe5d49e-e0d8-4f1f-b892-257c676bcfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe5d49e-e0d8-4f1f-b892-257c676bcfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4d8a01-a86f-4e5b-81e0-7ed8ec385baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4d8a01-a86f-4e5b-81e0-7ed8ec385baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b5465ae4-3158-40a1-99bc-0f8c0d4ca376', 'volume_name': 'volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbd8530-7f4e-4563-904e-dddc66a8e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbd8530-7f4e-4563-904e-dddc66a8e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f5fa2c-3091-4f45-8a08-2dc347673a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:28 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Volume b5465ae4-3158-40a1-99bc-0f8c0d4ca376: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 07:22:28 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Trying to clone b5465ae4-3158-40a1-99bc-0f8c0d4ca376 from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:22:29 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:22:29 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Image download 20.69 MB at 20.69 MB/s Sep 08 07:22:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea9f840-3495-4596-8d58-9191c60778e9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:29 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD Sep 08 07:22:29 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:30 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 is fetched for user 433dd44870794b0f903ed89fa2b33c4b. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d127a14-f71b-420a-84d1-596236f32e9c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:30 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD Sep 08 07:22:30 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Flow 'volume_create_manager' (95b11775-47f7-4afe-ba58-91bfeff93d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f2bd90-6305-4497-9471-6d0428e5346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f2bd90-6305-4497-9471-6d0428e5346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078359212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85853f0a-b3b9-4385-bea0-c42e0935efa5,host='devstack@QuobyteHD#QuobyteHD',id=23b385e6-f34e-445a-9041-a811251bf4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146a47e559f8429387f2ae496e6664e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:22:31Z,use_quota=True,user_id='6d0ffd543cbb485b8f0af4f5098a6bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cb4cece-5c48-4642-96f7-424f1617fd36),volume_type_id=4cb4cece-5c48-4642-96f7-424f1617fd36)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d125eb39-57d3-40a2-83f8-51c519f91abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d125eb39-57d3-40a2-83f8-51c519f91abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30b90dc-d0c3-425a-b2bc-eab58ba82a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30b90dc-d0c3-425a-b2bc-eab58ba82a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b385e6-f34e-445a-9041-a811251bf4a8', 'volume_name': 'volume-23b385e6-f34e-445a-9041-a811251bf4a8', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6720802b-6bcf-4336-9d53-052c645e7965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6720802b-6bcf-4336-9d53-052c645e7965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ed226c-7ab8-41b6-9684-cb6aba2376e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:30 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Volume 23b385e6-f34e-445a-9041-a811251bf4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b385e6-f34e-445a-9041-a811251bf4a8', 'volume_size': 1} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=85853f0a-b3b9-4385-bea0-c42e0935efa5,created_at=2026-09-08T05:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078359212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85853f0a-b3b9-4385-bea0-c42e0935efa5,host='devstack@QuobyteHD#QuobyteHD',id=23b385e6-f34e-445a-9041-a811251bf4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146a47e559f8429387f2ae496e6664e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:22:31Z,use_quota=True,user_id='6d0ffd543cbb485b8f0af4f5098a6bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cb4cece-5c48-4642-96f7-424f1617fd36),volume_type_id=4cb4cece-5c48-4642-96f7-424f1617fd36)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Creating volume 23b385e6-f34e-445a-9041-a811251bf4a8 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:22:30 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:22:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:30 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 1073741824 Sep 08 07:22:30 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Flow 'volume_create_manager' (508f0769-4773-47be-a1bd-083f97984f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd94da85-fcc9-47a8-8c88-19973fe5ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:31 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd94da85-fcc9-47a8-8c88-19973fe5ce23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1773541084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222a6ee7-3d99-44ac-871a-411e2c071e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f3a9f7431449669088cc7237856330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:22:31Z,use_quota=True,user_id='c1550c4abbbf49c1b62e5e05f9797cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f44ab1-ef94-468d-b3e0-7004a094fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f44ab1-ef94-468d-b3e0-7004a094fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64be20d6-c5ab-485d-aac1-7d516057b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64be20d6-c5ab-485d-aac1-7d516057b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222a6ee7-3d99-44ac-871a-411e2c071e3a', 'volume_name': 'volume-222a6ee7-3d99-44ac-871a-411e2c071e3a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ea5440-a0a8-4e7b-a134-2607b4acc9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ea5440-a0a8-4e7b-a134-2607b4acc9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1222cff3-cfd7-4675-ae23-1c48c1a7fe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:31 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Volume 222a6ee7-3d99-44ac-871a-411e2c071e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222a6ee7-3d99-44ac-871a-411e2c071e3a', 'volume_size': 1} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:31 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 1073741824" returned: 0 in 0.679s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:31 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 Sep 08 07:22:31 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:31 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8" returned: 0 in 0.306s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1773541084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222a6ee7-3d99-44ac-871a-411e2c071e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f3a9f7431449669088cc7237856330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:22:31Z,use_quota=True,user_id='c1550c4abbbf49c1b62e5e05f9797cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Creating volume 222a6ee7-3d99-44ac-871a-411e2c071e3a {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:22:31 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ed226c-7ab8-41b6-9684-cb6aba2376e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b385e6-f34e-445a-9041-a811251bf4a8', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:32 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a 1073741824 Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdce3f25-6caa-4c5f-aefe-0e6ba2cfa926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:32 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:32 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Volume volume-23b385e6-f34e-445a-9041-a811251bf4a8 (23b385e6-f34e-445a-9041-a811251bf4a8): created successfully Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdce3f25-6caa-4c5f-aefe-0e6ba2cfa926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Flow 'volume_create_manager' (95b11775-47f7-4afe-ba58-91bfeff93d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:22:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-425b9c72-0f20-440e-95c8-b1e09a7e77e5 tempest-GroupSnapshotsV319Test-1941228446 None] Created volume successfully. Sep 08 07:22:32 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a 1073741824" returned: 0 in 0.514s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:32 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a Sep 08 07:22:32 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:32 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a" returned: 0 in 0.326s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-929210678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5465ae4-3158-40a1-99bc-0f8c0d4ca376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ffa19a64af48b4a47334dc1f0ce407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:22:28Z,use_quota=True,user_id='433dd44870794b0f903ed89fa2b33c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Creating volume b5465ae4-3158-40a1-99bc-0f8c0d4ca376 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:22:32 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1222cff3-cfd7-4675-ae23-1c48c1a7fe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222a6ee7-3d99-44ac-871a-411e2c071e3a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:32 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 1073741824 Sep 08 07:22:32 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4616c0-f0bd-4dcf-809b-9b3d6967425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:33 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Volume volume-222a6ee7-3d99-44ac-871a-411e2c071e3a (222a6ee7-3d99-44ac-871a-411e2c071e3a): created successfully Sep 08 07:22:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4616c0-f0bd-4dcf-809b-9b3d6967425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Flow 'volume_create_manager' (508f0769-4773-47be-a1bd-083f97984f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:22:33 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3348cc52-3878-4c92-8a20-f06bd1121ee4 tempest-DeleteServersTestJSON-502581090 None] Created volume successfully. Sep 08 07:22:33 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] GroupSnapshot e6893f30-2ae1-4b67-8914-26309daddd9a: creating. Sep 08 07:22:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Group snapshot e6893f30-2ae1-4b67-8914-26309daddd9a: creating. {{(pid=87278) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 07:22:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:34 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 1073741824" returned: 0 in 1.200s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:34 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 Sep 08 07:22:34 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:34 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376" returned: 0 in 0.564s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.978s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Creating offline snapshot df546c79-5d6e-4496-b9ea-bf9bb217f5b8 of volume 23b385e6-f34e-445a-9041-a811251bf4a8 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Attempting download of cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume b5465ae4-3158-40a1-99bc-0f8c0d4ca376. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[724ddfb7-8f26-46a1-8c14-2e6784bd7e26]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:35 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbe326b-dcaf-4135-8ad4-0e7c6d8d8720]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3fur4xc2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:35 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 Sep 08 07:22:35 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:35 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3fur4xc2 Sep 08 07:22:35 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:35 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8" returned: 0 in 0.817s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:35 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 1G Sep 08 07:22:35 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:35 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-ad8a587f-ae89-439c-aa8f-3e9bb07bae92 req-89b39595-758a-4a66-81df-2f8e7d47a192 tempest-DeleteServersTestJSON-502581090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3fur4xc2" returned: 0 in 0.752s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3fur4xc2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:36 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3fur4xc2 Sep 08 07:22:36 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:36 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3fur4xc2" returned: 1 in 0.753s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:36 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3fur4xc2' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:22:36 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a313623d-958c-4c62-a0d7-07c293bafbb5]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 1G" returned: 0 in 0.924s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23b385e6-f34e-445a-9041-a811251bf4a8 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:36 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23b385e6-f34e-445a-9041-a811251bf4a8 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 Sep 08 07:22:36 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:36 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD Sep 08 07:22:36 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:37 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:37 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 was qcow2, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:22:37 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23b385e6-f34e-445a-9041-a811251bf4a8 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8" returned: 0 in 0.549s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:37 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:22:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:37 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 Sep 08 07:22:37 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:37 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 Sep 08 07:22:37 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:37 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8" returned: 0 in 0.383s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:37 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.info Sep 08 07:22:37 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:38 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.info" returned: 0 in 0.491s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:38 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:22:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:38 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.info Sep 08 07:22:38 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:38 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.info" returned: 0 in 0.646s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.141s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-ad8a587f-ae89-439c-aa8f-3e9bb07bae92 req-89b39595-758a-4a66-81df-2f8e7d47a192 tempest-DeleteServersTestJSON-502581090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.981s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-ad8a587f-ae89-439c-aa8f-3e9bb07bae92 req-89b39595-758a-4a66-81df-2f8e7d47a192 tempest-DeleteServersTestJSON-502581090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.105s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-ad8a587f-ae89-439c-aa8f-3e9bb07bae92 req-89b39595-758a-4a66-81df-2f8e7d47a192 tempest-DeleteServersTestJSON-502581090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-222a6ee7-3d99-44ac-871a-411e2c071e3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27785723-2730-43a2-b030-b22acd35a6d1', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:22:39 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b5637731-6f03-43ce-b665-0a8a10c1b0b1 tempest-GroupSnapshotsV319Test-1941228446 None] group_snapshot e6893f30-2ae1-4b67-8914-26309daddd9a: created successfully Sep 08 07:22:39 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-ad8a587f-ae89-439c-aa8f-3e9bb07bae92 req-89b39595-758a-4a66-81df-2f8e7d47a192 tempest-DeleteServersTestJSON-502581090 None] attachment_update completed successfully. Sep 08 07:22:40 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376" returned: 0 in 3.283s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_zqfyxjqjdevstack@QuobyteHD, size 112.00 MB, duration 3.28 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:22:40 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Converted 112.00 MB image at 34.11 MB/s Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:40 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 1G Sep 08 07:22:40 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] group_snapshot e6893f30-2ae1-4b67-8914-26309daddd9a: deleting Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] group_snapshot e6893f30-2ae1-4b67-8914-26309daddd9a: deleting {{(pid=87278) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Acquiring lock "cinder-quobyte-23b385e6-f34e-445a-9041-a811251bf4a8" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Lock "cinder-quobyte-23b385e6-f34e-445a-9041-a811251bf4a8" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Acquiring lock "cinder-quobyte-df546c79-5d6e-4496-b9ea-bf9bb217f5b8" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Lock "cinder-quobyte-df546c79-5d6e-4496-b9ea-bf9bb217f5b8" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Deleting offline snapshot df546c79-5d6e-4496-b9ea-bf9bb217f5b8 of volume 23b385e6-f34e-445a-9041-a811251bf4a8 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] snapshot_file for this snap is: volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[327cd013-ad00-4c4c-91e6-cd93db795bc1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:41 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 Sep 08 07:22:41 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:41 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 1G" returned: 0 in 0.896s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Downloaded image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume b5465ae4-3158-40a1-99bc-0f8c0d4ca376 successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 for user 433dd44870794b0f903ed89fa2b33c4b is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Marking volume b5465ae4-3158-40a1-99bc-0f8c0d4ca376 as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Copying metadata from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 to b5465ae4-3158-40a1-99bc-0f8c0d4ca376. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Creating volume glance metadata for volume b5465ae4-3158-40a1-99bc-0f8c0d4ca376 backed by image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f5fa2c-3091-4f45-8a08-2dc347673a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b83694-b9de-4682-9f24-c528a16d33e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:22:41 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Volume volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 (b5465ae4-3158-40a1-99bc-0f8c0d4ca376): created successfully Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b83694-b9de-4682-9f24-c528a16d33e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Flow 'volume_create_manager' (c21d14eb-89be-4793-9995-db422e61be24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:22:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3b93b938-4ebe-4e03-a4d0-1b730abd526d tempest-ServerActionsTestOtherA-1193629056 None] Created volume successfully. Sep 08 07:22:41 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8" returned: 0 in 0.913s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23b385e6-f34e-445a-9041-a811251bf4a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[65265e9e-aea3-4d57-8717-3220dfa3c486]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:42 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 Sep 08 07:22:42 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:42 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8" returned: 0 in 0.557s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:42 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 Sep 08 07:22:42 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:43 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8" returned: 0 in 0.777s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:43 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8 Sep 08 07:22:43 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:43 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8.df546c79-5d6e-4496-b9ea-bf9bb217f5b8" returned: 0 in 0.551s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Lock "cinder-quobyte-df546c79-5d6e-4496-b9ea-bf9bb217f5b8" released by "_delete_snapshot" :: held 3.065s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Lock "cinder-quobyte-23b385e6-f34e-445a-9041-a811251bf4a8" released by "delete_snapshot" :: held 3.158s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:22:44 devstack cinder-volume[87278]: WARNING cinder.quota [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2119106610 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2119106610, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:22:44 devstack cinder-volume[87278]: WARNING cinder.quota [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2119106610 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2119106610, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] Created reservations ['2d103a42-2896-4ed1-9962-38685963fcfa', 'ace64940-9016-414b-af90-007d03ead65f', 'ec2e6d89-cdca-410f-95b9-0f7fe5a87eee', 'dc688bde-79ed-488e-8768-5b0cfd1a8505'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:22:44 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0f673341-4356-44ae-a3f7-ddaf08d747fb tempest-GroupSnapshotsV319Test-1941228446 None] group_snapshot e6893f30-2ae1-4b67-8914-26309daddd9a: deleted successfully Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:44 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:22:44 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:45 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.513s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:22:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-059aa125-170f-4ab7-b5b8-ef73e666cee0 req-a0298281-a962-4000-8498-ec7673f8eaa5 tempest-DeleteServersTestJSON-502581090 None] Terminate volume connection completed successfully. Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-059aa125-170f-4ab7-b5b8-ef73e666cee0 req-a0298281-a962-4000-8498-ec7673f8eaa5 tempest-DeleteServersTestJSON-502581090 None] Deleting attachment 27785723-2730-43a2-b030-b22acd35a6d1. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Acquiring lock "cinder-quobyte-23b385e6-f34e-445a-9041-a811251bf4a8" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Lock "cinder-quobyte-23b385e6-f34e-445a-9041-a811251bf4a8" acquired by "delete_volume" :: waited 0.039s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a95066b-00ec-4ea3-9e56-26bc05ce21d7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:46 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 Sep 08 07:22:46 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:46 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8" returned: 0 in 0.759s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:46 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8 Sep 08 07:22:46 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:46 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-23b385e6-f34e-445a-9041-a811251bf4a8" returned: 0 in 0.410s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Lock "cinder-quobyte-23b385e6-f34e-445a-9041-a811251bf4a8" released by "delete_volume" :: held 1.283s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:22:47 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Created reservations ['2056e345-2f48-4ec2-92e7-7a6391aef267'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:22:47 devstack cinder-volume[87278]: WARNING cinder.quota [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2119106610 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2119106610, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:22:47 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Created reservations ['299adab7-368b-44d9-99ba-7e73afa1da9e', '3097471f-d220-4fd2-a636-e224b9455e42', 'cf0c1a7b-6998-4acf-9eb9-24a1c4def740', '250df967-d4cd-458c-9e89-378ebefda725'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:22:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:22:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:22:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:47 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:22:47 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:48 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.714s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:48 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:22:48 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-db864a43-0f28-4470-a03e-9bde25abb63f tempest-GroupSnapshotsV319Test-1941228446 None] Delete group completed successfully. Sep 08 07:22:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Acquiring lock "cinder-222a6ee7-3d99-44ac-871a-411e2c071e3a-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:22:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Lock "cinder-222a6ee7-3d99-44ac-871a-411e2c071e3a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:22:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Acquiring lock "cinder-quobyte-222a6ee7-3d99-44ac-871a-411e2c071e3a" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:22:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Lock "cinder-quobyte-222a6ee7-3d99-44ac-871a-411e2c071e3a" acquired by "delete_volume" :: waited 0.042s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:22:49 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5e4ba5-19b2-4523-bf45-becadcb71ec5]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:22:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:49 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a Sep 08 07:22:49 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:49 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a" returned: 0 in 0.978s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:50 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a Sep 08 07:22:50 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:50 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-222a6ee7-3d99-44ac-871a-411e2c071e3a" returned: 0 in 1.010s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Lock "cinder-quobyte-222a6ee7-3d99-44ac-871a-411e2c071e3a" released by "delete_volume" :: held 2.112s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Created reservations ['4f42395e-460d-484c-b5a9-52a7d4940b3b', '164d3b20-4ffe-42b4-a46d-8b8fa5444c01', 'cd2dfe55-0902-4d82-b00e-705913522496', 'b56b10b7-2204-4d19-bc53-3ecd68be131c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:22:51 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:22:51 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-da272e19-d084-47e4-9859-c35b556354bc req-c8b5296c-6609-47a5-a8ee-05051524f1db tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-da272e19-d084-47e4-9859-c35b556354bc req-c8b5296c-6609-47a5-a8ee-05051524f1db tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-da272e19-d084-47e4-9859-c35b556354bc req-c8b5296c-6609-47a5-a8ee-05051524f1db tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-da272e19-d084-47e4-9859-c35b556354bc req-c8b5296c-6609-47a5-a8ee-05051524f1db tempest-ServerActionsTestOtherA-1193629056 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4bb341a-eebc-4ad0-a755-040696b5ea0e', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:22:51 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.625s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:22:51 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Deleted volume successfully. Sep 08 07:22:51 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-da272e19-d084-47e4-9859-c35b556354bc req-c8b5296c-6609-47a5-a8ee-05051524f1db tempest-ServerActionsTestOtherA-1193629056 None] attachment_update completed successfully. Sep 08 07:22:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85197406-743f-45fa-8ca6-2b97035b16f7 tempest-DeleteServersTestJSON-502581090 None] Lock "cinder-222a6ee7-3d99-44ac-871a-411e2c071e3a-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Flow 'volume_create_manager' (ecfef3f8-d23d-4927-8f73-94b38c9163ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fcdfd8-d4a9-4f3d-bdfb-d7eaaf5a4f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fcdfd8-d4a9-4f3d-bdfb-d7eaaf5a4f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1510967211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652f4eaa-884d-4b49-82bf-bc84823c62ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01920baef7447eb62b5c7bf992cecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:01Z,use_quota=True,user_id='aa31d87f35974e8a9d4099c5c68be93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a311a2-c320-4c83-8581-ef375fdde064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a311a2-c320-4c83-8581-ef375fdde064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6abe88-9f0a-427b-957e-d7f784006966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6abe88-9f0a-427b-957e-d7f784006966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652f4eaa-884d-4b49-82bf-bc84823c62ec', 'volume_name': 'volume-652f4eaa-884d-4b49-82bf-bc84823c62ec', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f05b3a1-496f-4dc3-8966-8b3191198d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f05b3a1-496f-4dc3-8966-8b3191198d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3353bf05-3e51-4c21-bc9a-0f5e79dc3a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:01 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Volume 652f4eaa-884d-4b49-82bf-bc84823c62ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652f4eaa-884d-4b49-82bf-bc84823c62ec', 'volume_size': 1} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1510967211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652f4eaa-884d-4b49-82bf-bc84823c62ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01920baef7447eb62b5c7bf992cecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:01Z,use_quota=True,user_id='aa31d87f35974e8a9d4099c5c68be93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Creating volume 652f4eaa-884d-4b49-82bf-bc84823c62ec {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:23:01 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:23:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:01 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec 1073741824 Sep 08 07:23:01 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:02 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec 1073741824" returned: 0 in 0.773s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:02 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec Sep 08 07:23:02 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:03 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec" returned: 0 in 0.608s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:23:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3353bf05-3e51-4c21-bc9a-0f5e79dc3a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652f4eaa-884d-4b49-82bf-bc84823c62ec', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66acbe47-886a-4e67-a745-49ece0f7b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:03 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Volume volume-652f4eaa-884d-4b49-82bf-bc84823c62ec (652f4eaa-884d-4b49-82bf-bc84823c62ec): created successfully Sep 08 07:23:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66acbe47-886a-4e67-a745-49ece0f7b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Flow 'volume_create_manager' (ecfef3f8-d23d-4927-8f73-94b38c9163ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:03 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9a2ac7c2-8069-4fd8-9761-4428ae9e0be6 tempest-ServersNegativeTestJSON-2064448191 None] Created volume successfully. Sep 08 07:23:06 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:23:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Flow 'volume_create_manager' (30ea9a9e-3e7c-413a-a8c7-360578a97abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e207cb27-873a-43e4-ad8e-ede12b32f963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e207cb27-873a-43e4-ad8e-ede12b32f963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-258860644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa459a1-efdd-4705-bbea-760b9ee70cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01920baef7447eb62b5c7bf992cecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:07Z,use_quota=True,user_id='aa31d87f35974e8a9d4099c5c68be93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46f53f6-0651-4038-94b0-a5597e14d37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46f53f6-0651-4038-94b0-a5597e14d37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a86f1e-e312-4de0-9204-7f5db028d8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a86f1e-e312-4de0-9204-7f5db028d8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa459a1-efdd-4705-bbea-760b9ee70cf9', 'volume_name': 'volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f0c5f5-984f-4c0a-afb0-d93116f1166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f0c5f5-984f-4c0a-afb0-d93116f1166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3351e133-5e2a-4428-b65d-7f6a3a46befa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:07 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Volume 0aa459a1-efdd-4705-bbea-760b9ee70cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9', 'volume_size': 1} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-258860644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa459a1-efdd-4705-bbea-760b9ee70cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01920baef7447eb62b5c7bf992cecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:07Z,use_quota=True,user_id='aa31d87f35974e8a9d4099c5c68be93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Creating volume 0aa459a1-efdd-4705-bbea-760b9ee70cf9 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:23:07 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:07 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 1073741824 Sep 08 07:23:07 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:07 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 1073741824" returned: 0 in 0.705s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:07 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 Sep 08 07:23:07 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:08 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9" returned: 0 in 0.361s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:23:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3351e133-5e2a-4428-b65d-7f6a3a46befa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83eb9d6c-73c5-475a-a17a-b8fda3d4b813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:08 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Volume volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 (0aa459a1-efdd-4705-bbea-760b9ee70cf9): created successfully Sep 08 07:23:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83eb9d6c-73c5-475a-a17a-b8fda3d4b813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Flow 'volume_create_manager' (30ea9a9e-3e7c-413a-a8c7-360578a97abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:08 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-acabaae4-984c-486f-90fe-e833fd6081ba tempest-ServersNegativeTestJSON-2064448191 None] Created volume successfully. Sep 08 07:23:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "cinder-0aa459a1-efdd-4705-bbea-760b9ee70cf9-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Lock "cinder-0aa459a1-efdd-4705-bbea-760b9ee70cf9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "cinder-quobyte-0aa459a1-efdd-4705-bbea-760b9ee70cf9" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Lock "cinder-quobyte-0aa459a1-efdd-4705-bbea-760b9ee70cf9" acquired by "delete_volume" :: waited 0.034s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:10 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c76f5c-e2d9-4240-826a-d4b34f768540]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:23:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:10 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 Sep 08 07:23:10 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:11 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9" returned: 0 in 0.708s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:11 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9 Sep 08 07:23:11 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:11 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0aa459a1-efdd-4705-bbea-760b9ee70cf9" returned: 0 in 0.500s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Lock "cinder-quobyte-0aa459a1-efdd-4705-bbea-760b9ee70cf9" released by "delete_volume" :: held 1.274s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:11 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Created reservations ['2ba8ffca-8ca6-4bda-bc82-6e7ef54580fa', '81221f2b-a7de-445c-b7e4-7bfb541b042d', '261cf3ab-5c0f-4265-9df2-46b3aded9c75', 'aaf29999-513b-4e0d-b8be-c17f065483fd'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:12 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:23:12 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:12 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.446s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:23:12 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Deleted volume successfully. Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fba0629b-40a9-4713-a38d-191e53e2683f tempest-ServersNegativeTestJSON-2064448191 None] Lock "cinder-0aa459a1-efdd-4705-bbea-760b9ee70cf9-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "cinder-652f4eaa-884d-4b49-82bf-bc84823c62ec-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Lock "cinder-652f4eaa-884d-4b49-82bf-bc84823c62ec-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "cinder-quobyte-652f4eaa-884d-4b49-82bf-bc84823c62ec" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:13 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-1e2f0a19-f6a0-4282-91f1-db6451436e6e req-f127c09a-8213-422b-9c08-80be6d993ee3 tempest-ServerActionsTestOtherA-1193629056 None] Terminate volume connection completed successfully. Sep 08 07:23:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-1e2f0a19-f6a0-4282-91f1-db6451436e6e req-f127c09a-8213-422b-9c08-80be6d993ee3 tempest-ServerActionsTestOtherA-1193629056 None] Deleting attachment d4bb341a-eebc-4ad0-a755-040696b5ea0e. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:23:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Lock "cinder-quobyte-652f4eaa-884d-4b49-82bf-bc84823c62ec" acquired by "delete_volume" :: waited 0.055s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:13 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ba7dd3-9f18-40ed-9a1f-8504fdc473e8]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:23:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:13 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec Sep 08 07:23:13 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:13 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec" returned: 0 in 0.612s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:13 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec Sep 08 07:23:13 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:14 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-652f4eaa-884d-4b49-82bf-bc84823c62ec" returned: 0 in 0.423s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Lock "cinder-quobyte-652f4eaa-884d-4b49-82bf-bc84823c62ec" released by "delete_volume" :: held 1.163s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Created reservations ['fa8fef7b-a8ca-4914-8c6c-7f28a4b15746', 'ad5bcd3f-91aa-42e3-8547-370a06d5e663', 'c508162e-93fb-41ff-9867-5287379fb6b9', '0762f720-3061-46a9-ac15-be7b4f90069c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:14 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:23:14 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:14 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.324s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:23:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Deleted volume successfully. Sep 08 07:23:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f1572180-b86c-454f-a222-d2af80c59d53 tempest-ServersNegativeTestJSON-2064448191 None] Lock "cinder-652f4eaa-884d-4b49-82bf-bc84823c62ec-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-1e2f0a19-f6a0-4282-91f1-db6451436e6e req-5f689248-b9ad-4a7d-895a-86b366f1da58 tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-1e2f0a19-f6a0-4282-91f1-db6451436e6e req-5f689248-b9ad-4a7d-895a-86b366f1da58 tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-1e2f0a19-f6a0-4282-91f1-db6451436e6e req-5f689248-b9ad-4a7d-895a-86b366f1da58 tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Flow 'volume_create_manager' (02494496-2b10-45a6-af0e-b0bf72cf6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74e76dd-ce5c-41ea-a7fb-e1a5db885eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74e76dd-ce5c-41ea-a7fb-e1a5db885eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1885064218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173bc5ed-5620-47f1-9245-6b8e55da6d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da2d9840fa34f5bb1615797244d82c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:16Z,use_quota=True,user_id='cec960e4b1ec4f1a83976ab5e9a4556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1abc75f-4f46-405f-a29f-40133238c194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1abc75f-4f46-405f-a29f-40133238c194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59968656-52d8-4100-83f0-2162458eabbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59968656-52d8-4100-83f0-2162458eabbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173bc5ed-5620-47f1-9245-6b8e55da6d56', 'volume_name': 'volume-173bc5ed-5620-47f1-9245-6b8e55da6d56', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc5c9f8-f518-478b-b7c4-bcd551bb2988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc5c9f8-f518-478b-b7c4-bcd551bb2988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d5b7fa-3ce0-48b2-9e72-36216bd51755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:15 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Volume 173bc5ed-5620-47f1-9245-6b8e55da6d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173bc5ed-5620-47f1-9245-6b8e55da6d56', 'volume_size': 1} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1885064218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173bc5ed-5620-47f1-9245-6b8e55da6d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da2d9840fa34f5bb1615797244d82c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:16Z,use_quota=True,user_id='cec960e4b1ec4f1a83976ab5e9a4556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Creating volume 173bc5ed-5620-47f1-9245-6b8e55da6d56 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:23:15 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-1e2f0a19-f6a0-4282-91f1-db6451436e6e req-5f689248-b9ad-4a7d-895a-86b366f1da58 tempest-ServerActionsTestOtherA-1193629056 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae72fa6e-b082-45d1-8d8e-d567b9666aa5', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:23:15 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 1073741824 Sep 08 07:23:15 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:15 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-1e2f0a19-f6a0-4282-91f1-db6451436e6e req-5f689248-b9ad-4a7d-895a-86b366f1da58 tempest-ServerActionsTestOtherA-1193629056 None] attachment_update completed successfully. Sep 08 07:23:16 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 1073741824" returned: 0 in 0.725s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:16 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 Sep 08 07:23:16 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:17 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56" returned: 0 in 0.435s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:23:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d5b7fa-3ce0-48b2-9e72-36216bd51755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173bc5ed-5620-47f1-9245-6b8e55da6d56', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6d97b0-dfd4-40ca-af90-e80d1e7a9b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Volume volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 (173bc5ed-5620-47f1-9245-6b8e55da6d56): created successfully Sep 08 07:23:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6d97b0-dfd4-40ca-af90-e80d1e7a9b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Flow 'volume_create_manager' (02494496-2b10-45a6-af0e-b0bf72cf6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-42ea4c88-cf86-4117-ab21-a23dee081de5 tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Created volume successfully. Sep 08 07:23:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Acquiring lock "cinder-173bc5ed-5620-47f1-9245-6b8e55da6d56-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "cinder-173bc5ed-5620-47f1-9245-6b8e55da6d56-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Acquiring lock "cinder-quobyte-173bc5ed-5620-47f1-9245-6b8e55da6d56" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "cinder-quobyte-173bc5ed-5620-47f1-9245-6b8e55da6d56" acquired by "delete_volume" :: waited 0.049s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:19 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca93743-cba2-43dd-891d-ac22596fc0b3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:23:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:19 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 Sep 08 07:23:19 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:20 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56" returned: 0 in 0.524s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:20 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56 Sep 08 07:23:20 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:20 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-173bc5ed-5620-47f1-9245-6b8e55da6d56" returned: 0 in 0.432s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "cinder-quobyte-173bc5ed-5620-47f1-9245-6b8e55da6d56" released by "delete_volume" :: held 1.047s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Created reservations ['d9a23301-62e1-4c2d-809e-6c5f9e572c31', 'f44c04f2-17b0-4bab-967f-9ec79459207e', '4e7d2305-0187-46ae-9992-bb005a586ec6', '37be2c6f-e827-45f5-89e5-b557fdc1efb1'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:20 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:23:20 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:21 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.374s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:21 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:23:21 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Deleted volume successfully. Sep 08 07:23:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b0b749e4-1e9a-434c-8dcf-e8225b44dbea tempest-VolumeQuotasNegativeTestJSON-2048743466 None] Lock "cinder-173bc5ed-5620-47f1-9245-6b8e55da6d56-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:30 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=84,cinder:UPDATE=72,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:23:31 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=84,cinder:UPDATE=81,cinder:INSERT=26,cinder:DELETE=5 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:23:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:23:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:44 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:23:44 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:45 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.706s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:23:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:23:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:23:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Flow 'volume_create_manager' (5341098b-e49c-46d1-8120-e2e67d5a5810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54832c83-970f-4369-943a-0bd66645413b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54832c83-970f-4369-943a-0bd66645413b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1204063525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fac24a2eb4506a5a4efb918108246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:52Z,use_quota=True,user_id='0ab9a304f18a46708541a083568f15bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373ad294-5c78-40ee-8c0a-6a306ed52950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373ad294-5c78-40ee-8c0a-6a306ed52950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8885a5f8-329b-407e-8feb-9cddd62b71c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8885a5f8-329b-407e-8feb-9cddd62b71c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93', 'volume_name': 'volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513ba6c9-bba3-4bf8-b942-41e9440553c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513ba6c9-bba3-4bf8-b942-41e9440553c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24517799-0b6e-46ad-b295-f16f1472081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:51 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Volume 0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93', 'volume_size': 1} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1204063525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fac24a2eb4506a5a4efb918108246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:52Z,use_quota=True,user_id='0ab9a304f18a46708541a083568f15bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Creating volume 0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:23:51 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:23:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:51 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 1073741824 Sep 08 07:23:51 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:52 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 1073741824" returned: 0 in 0.877s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:52 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 Sep 08 07:23:52 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:53 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93" returned: 0 in 0.428s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:23:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24517799-0b6e-46ad-b295-f16f1472081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f621165-4230-4633-9caa-102c35d93977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:53 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Volume volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 (0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93): created successfully Sep 08 07:23:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f621165-4230-4633-9caa-102c35d93977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Flow 'volume_create_manager' (5341098b-e49c-46d1-8120-e2e67d5a5810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:53 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-498dc6ec-c630-458b-bc4b-c5c2eb052311 tempest-VolumesListAdminTestJSON-1548383700 None] Created volume successfully. Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Flow 'volume_create_manager' (60d5d15f-bba4-4a97-b059-2d36ffbd9043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf27305-0b89-4c97-b12c-ea770181800e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf27305-0b89-4c97-b12c-ea770181800e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-357071959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4208750c-a843-4f06-adfe-a2bcb78f9115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fac24a2eb4506a5a4efb918108246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:54Z,use_quota=True,user_id='0ab9a304f18a46708541a083568f15bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7800fad-486c-4399-9ce7-307c75bf88b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7800fad-486c-4399-9ce7-307c75bf88b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d780f76-a857-4cb9-a249-bd759a4a3ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d780f76-a857-4cb9-a249-bd759a4a3ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4208750c-a843-4f06-adfe-a2bcb78f9115', 'volume_name': 'volume-4208750c-a843-4f06-adfe-a2bcb78f9115', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbe3bc7-f57a-4b9c-a8b5-d3faf58a4a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbe3bc7-f57a-4b9c-a8b5-d3faf58a4a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16aad73-c8c4-41f1-a354-0b0514996b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:54 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Volume 4208750c-a843-4f06-adfe-a2bcb78f9115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4208750c-a843-4f06-adfe-a2bcb78f9115', 'volume_size': 1} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-357071959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4208750c-a843-4f06-adfe-a2bcb78f9115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fac24a2eb4506a5a4efb918108246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:54Z,use_quota=True,user_id='0ab9a304f18a46708541a083568f15bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Creating volume 4208750c-a843-4f06-adfe-a2bcb78f9115 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:23:54 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:23:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:54 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115 1073741824 Sep 08 07:23:54 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:55 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-c6577d4f-9475-427a-bb3f-59fc4413ac40 tempest-ServerActionsTestOtherA-1193629056 None] Terminate volume connection completed successfully. Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-c6577d4f-9475-427a-bb3f-59fc4413ac40 tempest-ServerActionsTestOtherA-1193629056 None] Deleting attachment ae72fa6e-b082-45d1-8d8e-d567b9666aa5. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:23:55 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115 1073741824" returned: 0 in 0.596s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:55 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115 Sep 08 07:23:55 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "cinder-b5465ae4-3158-40a1-99bc-0f8c0d4ca376-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Lock "cinder-b5465ae4-3158-40a1-99bc-0f8c0d4ca376-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "cinder-quobyte-b5465ae4-3158-40a1-99bc-0f8c0d4ca376" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Lock "cinder-quobyte-b5465ae4-3158-40a1-99bc-0f8c0d4ca376" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[204fedc5-6874-467c-ab19-d64e9f32a9c3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:55 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115" returned: 0 in 0.373s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16aad73-c8c4-41f1-a354-0b0514996b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4208750c-a843-4f06-adfe-a2bcb78f9115', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b571e5d-4936-4625-818a-f42d4545d99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:55 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Volume volume-4208750c-a843-4f06-adfe-a2bcb78f9115 (4208750c-a843-4f06-adfe-a2bcb78f9115): created successfully Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b571e5d-4936-4625-818a-f42d4545d99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Flow 'volume_create_manager' (60d5d15f-bba4-4a97-b059-2d36ffbd9043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:55 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 Sep 08 07:23:55 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:55 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-75009fb7-9c19-4c6c-80eb-79b72ef42c55 tempest-VolumesListAdminTestJSON-1548383700 None] Created volume successfully. Sep 08 07:23:55 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376" returned: 0 in 0.486s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "cinder-addda4a8-f32c-448d-b778-e4e960182109-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:55 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376 Sep 08 07:23:55 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Lock "cinder-addda4a8-f32c-448d-b778-e4e960182109-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "cinder-quobyte-addda4a8-f32c-448d-b778-e4e960182109" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Lock "cinder-quobyte-addda4a8-f32c-448d-b778-e4e960182109" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe2cf45-b817-47df-8b11-5fd82e7be592]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:56 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109 Sep 08 07:23:56 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:56 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b5465ae4-3158-40a1-99bc-0f8c0d4ca376" returned: 0 in 0.341s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Lock "cinder-quobyte-b5465ae4-3158-40a1-99bc-0f8c0d4ca376" released by "delete_volume" :: held 0.887s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG cinder.quota [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Created reservations ['686089d0-7376-4557-be2e-ea8997649ec1', '1a8ea8b6-d31a-4aea-8eef-88041a38b1f7', 'e1d62d68-66ed-41fa-b461-499faea5e195', 'eb653603-87fe-4946-8d5d-b7f29a059574'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:56 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:23:56 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:56 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109" returned: 0 in 0.585s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:56 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109 Sep 08 07:23:56 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:56 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.376s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG cinder.manager [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:23:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Deleted volume successfully. Sep 08 07:23:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9f8ae468-6601-4fcd-8eba-43c44b09d6ea req-ce53f7a8-b396-4518-8e81-449efc6b9fb5 tempest-ServerActionsTestOtherA-1193629056 None] Lock "cinder-b5465ae4-3158-40a1-99bc-0f8c0d4ca376-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:57 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-addda4a8-f32c-448d-b778-e4e960182109" returned: 0 in 0.355s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Lock "cinder-quobyte-addda4a8-f32c-448d-b778-e4e960182109" released by "delete_volume" :: held 0.992s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Created reservations ['07aab327-5bb6-4e06-a8a6-62c1275dc33d', '568277da-0834-4673-93c7-f10acc175c6d', '8577e42a-b68c-47d8-ab67-1cda416bd41e', '851ce7f8-deac-4de4-8ac5-65f44c1dfdd9'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:57 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:23:57 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Flow 'volume_create_manager' (db93b8ad-7469-43f2-adcb-a544849eab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d05f616-44f3-4c51-95c5-aacac80117dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d05f616-44f3-4c51-95c5-aacac80117dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1024314918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93c9e72-5e9c-4b5e-8047-9b2835073bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fac24a2eb4506a5a4efb918108246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:57Z,use_quota=True,user_id='0ab9a304f18a46708541a083568f15bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d84b6a0-fbf0-4640-b99a-8c51d97b4178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d84b6a0-fbf0-4640-b99a-8c51d97b4178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5eb5d8-3e94-4fbc-b6cc-f8627cef941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5eb5d8-3e94-4fbc-b6cc-f8627cef941e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93c9e72-5e9c-4b5e-8047-9b2835073bda', 'volume_name': 'volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9c387a-6b28-417f-8e27-d31f168301d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9c387a-6b28-417f-8e27-d31f168301d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe77bf63-0aa3-42c4-9324-b44afe4a457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:57 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Volume f93c9e72-5e9c-4b5e-8047-9b2835073bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda', 'volume_size': 1} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1024314918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93c9e72-5e9c-4b5e-8047-9b2835073bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fac24a2eb4506a5a4efb918108246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:23:57Z,use_quota=True,user_id='0ab9a304f18a46708541a083568f15bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Creating volume f93c9e72-5e9c-4b5e-8047-9b2835073bda {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:23:57 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:57 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda 1073741824 Sep 08 07:23:57 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:57 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.307s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:23:57 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Deleted volume successfully. Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-47ecfc76-4cb5-4cb2-b023-4d55ae83be84 tempest-ServerActionsTestOtherA-1193629056 None] Lock "cinder-addda4a8-f32c-448d-b778-e4e960182109-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:23:57 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda 1073741824" returned: 0 in 0.496s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:23:58 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda Sep 08 07:23:58 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:23:58 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Sep 08 07:23:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda" returned: 0 in 0.355s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:23:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:23:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:23:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe77bf63-0aa3-42c4-9324-b44afe4a457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd22cb1-aea6-4b68-934d-7d7346d6c49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:23:58 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Volume volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda (f93c9e72-5e9c-4b5e-8047-9b2835073bda): created successfully Sep 08 07:23:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd22cb1-aea6-4b68-934d-7d7346d6c49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:23:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Flow 'volume_create_manager' (db93b8ad-7469-43f2-adcb-a544849eab6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:23:58 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-cbfc30b9-8f11-49a5-8b52-b24315c92183 tempest-VolumesListAdminTestJSON-1548383700 None] Created volume successfully. Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Flow 'volume_create_manager' (65e803ee-ea7e-41ca-abb1-e574108d8a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ecff20-250b-408d-b7ba-a7619876fed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ecff20-250b-408d-b7ba-a7619876fed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4ae101-5c62-4f2e-a2c8-bbe76a048054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876852c0a9064c1fbc086c45da928006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:01Z,use_quota=True,user_id='c181173c876b4269b47df2c02afe47b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe63611-7cd7-49b7-98e5-3d5bfcedd4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe63611-7cd7-49b7-98e5-3d5bfcedd4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7dc847-fc1a-4eb3-9792-3c2755a3f988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7dc847-fc1a-4eb3-9792-3c2755a3f988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4ae101-5c62-4f2e-a2c8-bbe76a048054', 'volume_name': 'volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ff0a1b-96b4-4210-94a2-44c41f1f0635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ff0a1b-96b4-4210-94a2-44c41f1f0635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ffddf3-8e2b-4aa8-b9bd-36f5aa8c2071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:01 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Volume 4a4ae101-5c62-4f2e-a2c8-bbe76a048054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054', 'volume_size': 1} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4ae101-5c62-4f2e-a2c8-bbe76a048054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876852c0a9064c1fbc086c45da928006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:01Z,use_quota=True,user_id='c181173c876b4269b47df2c02afe47b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Creating volume 4a4ae101-5c62-4f2e-a2c8-bbe76a048054 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:24:01 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:24:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:01 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 1073741824 Sep 08 07:24:01 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:02 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 1073741824" returned: 0 in 0.795s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:02 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 Sep 08 07:24:02 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:02 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054" returned: 0 in 0.389s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:24:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ffddf3-8e2b-4aa8-b9bd-36f5aa8c2071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb21a18-36df-41da-96cb-7997f4c772b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:02 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Volume volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 (4a4ae101-5c62-4f2e-a2c8-bbe76a048054): created successfully Sep 08 07:24:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb21a18-36df-41da-96cb-7997f4c772b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Flow 'volume_create_manager' (65e803ee-ea7e-41ca-abb1-e574108d8a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:02 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-95576512-13d8-4af6-978e-eacaddd8ea69 tempest-VolumesListAdminTestJSON-1455735926 None] Created volume successfully. Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Acquiring lock "cinder-4a4ae101-5c62-4f2e-a2c8-bbe76a048054-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Lock "cinder-4a4ae101-5c62-4f2e-a2c8-bbe76a048054-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Acquiring lock "cinder-quobyte-4a4ae101-5c62-4f2e-a2c8-bbe76a048054" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "cinder-f93c9e72-5e9c-4b5e-8047-9b2835073bda-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Lock "cinder-quobyte-4a4ae101-5c62-4f2e-a2c8-bbe76a048054" acquired by "delete_volume" :: waited 0.129s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-f93c9e72-5e9c-4b5e-8047-9b2835073bda-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[956fc179-bf8c-4304-b732-6ed5b7c5e946]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "cinder-quobyte-f93c9e72-5e9c-4b5e-8047-9b2835073bda" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-quobyte-f93c9e72-5e9c-4b5e-8047-9b2835073bda" acquired by "delete_volume" :: waited 0.044s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f9b145-1143-4390-ac78-e89da5e099bb]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:24:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:03 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 Sep 08 07:24:03 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:04 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda Sep 08 07:24:04 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:04 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054" returned: 0 in 0.728s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:04 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054 Sep 08 07:24:04 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:04 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda" returned: 0 in 1.037s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:04 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda Sep 08 07:24:04 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:24:05 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Flow 'volume_create_manager' (653630a2-36a2-4b52-875a-684a4b7656e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b352d6c-860e-48e3-a458-6494f17583ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a4ae101-5c62-4f2e-a2c8-bbe76a048054" returned: 0 in 0.792s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Lock "cinder-quobyte-4a4ae101-5c62-4f2e-a2c8-bbe76a048054" released by "delete_volume" :: held 1.667s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b352d6c-860e-48e3-a458-6494f17583ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-528466775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa57dc8-038a-4271-a5f3-11ef92111e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91aa7d30d6949b78e89097f66d64043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:05Z,use_quota=True,user_id='13c19a52f64f484891c1f42a123bffba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84b94be-7740-4c63-a0d9-f3f508cfdb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84b94be-7740-4c63-a0d9-f3f508cfdb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8239a3d0-a9f9-4edc-bc6d-4d969953bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8239a3d0-a9f9-4edc-bc6d-4d969953bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa57dc8-038a-4271-a5f3-11ef92111e01', 'volume_name': 'volume-2fa57dc8-038a-4271-a5f3-11ef92111e01', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba338d94-51a8-4cbe-af89-c90fca2319ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba338d94-51a8-4cbe-af89-c90fca2319ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2b765-05ca-48cc-b3c2-8fcd3258361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:05 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Volume 2fa57dc8-038a-4271-a5f3-11ef92111e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa57dc8-038a-4271-a5f3-11ef92111e01', 'volume_size': 1} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-528466775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa57dc8-038a-4271-a5f3-11ef92111e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91aa7d30d6949b78e89097f66d64043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:05Z,use_quota=True,user_id='13c19a52f64f484891c1f42a123bffba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Creating volume 2fa57dc8-038a-4271-a5f3-11ef92111e01 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:24:05 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:05 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f93c9e72-5e9c-4b5e-8047-9b2835073bda" returned: 0 in 0.482s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:05 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 1073741824 Sep 08 07:24:05 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-quobyte-f93c9e72-5e9c-4b5e-8047-9b2835073bda" released by "delete_volume" :: held 1.611s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Created reservations ['03feda1f-377e-46f4-84f7-da8378092f78', 'eed366cf-cda2-4cb5-9ed6-7f4da22eb0b8', 'e71a32cf-2c7b-4baf-9796-30590a0a8b95', '0c43a70c-c633-4a0b-9274-89bca53e57ab'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Created reservations ['85435988-59ad-40ed-8296-8d6cb54f1f20', '84138d84-550c-4126-8ea6-f77fdae095fb', '05f39cdb-cf51-4ed4-8c87-afde962d2a60', '78278c59-3c63-4429-a7c2-3147a6af1cab'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:05 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:24:05 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:05 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:24:05 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:06 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:24:06 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Deleted volume successfully. Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a26a3049-f6ec-4fb3-8e1f-82726991a72c tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-f93c9e72-5e9c-4b5e-8047-9b2835073bda-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "cinder-4208750c-a843-4f06-adfe-a2bcb78f9115-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-4208750c-a843-4f06-adfe-a2bcb78f9115-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:06 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 1073741824" returned: 0 in 1.031s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:06 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.745s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "cinder-quobyte-4208750c-a843-4f06-adfe-a2bcb78f9115" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:06 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Deleted volume successfully. Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-quobyte-4208750c-a843-4f06-adfe-a2bcb78f9115" acquired by "delete_volume" :: waited 0.077s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c115483-607c-462e-b3f6-30f9b03bc3c5]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:06 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 Sep 08 07:24:06 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-af7b8219-472d-4c36-ba8b-abd5ab58561b tempest-VolumesListAdminTestJSON-1455735926 None] Lock "cinder-4a4ae101-5c62-4f2e-a2c8-bbe76a048054-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:06 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115 Sep 08 07:24:06 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:06 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01" returned: 0 in 0.347s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2b765-05ca-48cc-b3c2-8fcd3258361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa57dc8-038a-4271-a5f3-11ef92111e01', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ba4060-816c-4849-a3b0-f884e006819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:06 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Volume volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 (2fa57dc8-038a-4271-a5f3-11ef92111e01): created successfully Sep 08 07:24:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ba4060-816c-4849-a3b0-f884e006819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Flow 'volume_create_manager' (653630a2-36a2-4b52-875a-684a4b7656e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:07 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-184c6895-073f-4a7c-96e4-04aa95dd93a7 tempest-AttachVolumeTestJSON-1462399904 None] Created volume successfully. Sep 08 07:24:07 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115" returned: 0 in 0.593s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:07 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115 Sep 08 07:24:07 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:07 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4208750c-a843-4f06-adfe-a2bcb78f9115" returned: 0 in 0.319s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-quobyte-4208750c-a843-4f06-adfe-a2bcb78f9115" released by "delete_volume" :: held 0.998s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Created reservations ['edd72853-a64d-4e4e-a557-417b9bd2849f', 'ca0c4d0e-a4fb-463b-8036-7d7b517c3f3b', 'a6e0ef06-b365-47cf-bee5-1141060dfda5', '5fc959d6-1859-4674-ae32-d618dfa10483'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:07 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:24:07 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:08 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.348s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:24:08 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Deleted volume successfully. Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3a0fb4c5-0769-4aaa-9bef-7c81ebe1c11e tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-4208750c-a843-4f06-adfe-a2bcb78f9115-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-ab14db59-fa62-40de-bd92-b7c384658ea0 req-e581d4e5-462f-412c-a4ca-b766a40bf63e tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-ab14db59-fa62-40de-bd92-b7c384658ea0 req-e581d4e5-462f-412c-a4ca-b766a40bf63e tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-ab14db59-fa62-40de-bd92-b7c384658ea0 req-e581d4e5-462f-412c-a4ca-b766a40bf63e tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-ab14db59-fa62-40de-bd92-b7c384658ea0 req-e581d4e5-462f-412c-a4ca-b766a40bf63e tempest-AttachVolumeTestJSON-1462399904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-2fa57dc8-038a-4271-a5f3-11ef92111e01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a79b4e69-664c-4667-8c4c-4508ac670b9f', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:24:08 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-ab14db59-fa62-40de-bd92-b7c384658ea0 req-e581d4e5-462f-412c-a4ca-b766a40bf63e tempest-AttachVolumeTestJSON-1462399904 None] attachment_update completed successfully. Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "cinder-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "cinder-quobyte-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-quobyte-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21acd1b-5f23-479e-a7ee-e87d6e1ea961]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:24:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:09 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 Sep 08 07:24:09 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:09 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93" returned: 0 in 0.716s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:09 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93 Sep 08 07:24:09 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:09 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93" returned: 0 in 0.312s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-quobyte-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93" released by "delete_volume" :: held 1.087s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Created reservations ['1d51efcb-6d57-4195-917f-b44efece0a09', '706e87c1-c7dd-4ceb-83fb-6fcd50c82aae', '4dc6eb1b-f59f-40f1-a0ee-c08e9eec22d1', '963bc322-2a30-4142-8457-a0439f8218f7'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:10 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:24:10 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:10 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.484s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:24:10 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Deleted volume successfully. Sep 08 07:24:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9274d8b4-f075-4306-a4da-d631c4af7f93 tempest-VolumesListAdminTestJSON-1548383700 None] Lock "cinder-0272bdd9-a7e7-4f6b-83fa-4fa60fe1fb93-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:20 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=69,cinder:SELECT=49,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:24:20 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=46,cinder:UPDATE=60,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Flow 'volume_create_manager' (0118198c-99ba-42ff-bc57-8ca3eab67442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc9d8a4-6f86-4a6e-94a3-507b77300d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc9d8a4-6f86-4a6e-94a3-507b77300d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1132129441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede67497-7e82-4452-b818-923092db3f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afecd9fae4f43b8a74e190c23f28a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:24Z,use_quota=True,user_id='9eb5c71f4dbb43109265836c58d56f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a3aa74-3823-41be-84b7-19c451ec40b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a3aa74-3823-41be-84b7-19c451ec40b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9dccbcd-166b-4bba-b569-f1541626991d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9dccbcd-166b-4bba-b569-f1541626991d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede67497-7e82-4452-b818-923092db3f03', 'volume_name': 'volume-ede67497-7e82-4452-b818-923092db3f03', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb54f014-781a-48ed-a190-ccbf39ff90c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb54f014-781a-48ed-a190-ccbf39ff90c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6522d8bb-cc81-4a06-b959-8016d272d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Volume ede67497-7e82-4452-b818-923092db3f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede67497-7e82-4452-b818-923092db3f03', 'volume_size': 1} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1132129441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede67497-7e82-4452-b818-923092db3f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afecd9fae4f43b8a74e190c23f28a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:24Z,use_quota=True,user_id='9eb5c71f4dbb43109265836c58d56f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Creating volume ede67497-7e82-4452-b818-923092db3f03 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:24:23 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:24:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:23 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03 1073741824 Sep 08 07:24:23 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:24 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03 1073741824" returned: 0 in 0.483s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:24 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03 Sep 08 07:24:24 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:24 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03" returned: 0 in 0.268s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:24:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6522d8bb-cc81-4a06-b959-8016d272d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede67497-7e82-4452-b818-923092db3f03', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5722513-d984-4916-a8b6-a71560a0a3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:24 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Volume volume-ede67497-7e82-4452-b818-923092db3f03 (ede67497-7e82-4452-b818-923092db3f03): created successfully Sep 08 07:24:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5722513-d984-4916-a8b6-a71560a0a3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Flow 'volume_create_manager' (0118198c-99ba-42ff-bc57-8ca3eab67442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:24 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-79bb53e9-cc44-4a8d-982f-91c1163a7e74 tempest-VolumesMetadataTest-2086633804 None] Created volume successfully. Sep 08 07:24:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Acquiring lock "cinder-ede67497-7e82-4452-b818-923092db3f03-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Lock "cinder-ede67497-7e82-4452-b818-923092db3f03-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Acquiring lock "cinder-quobyte-ede67497-7e82-4452-b818-923092db3f03" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Lock "cinder-quobyte-ede67497-7e82-4452-b818-923092db3f03" acquired by "delete_volume" :: waited 0.048s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f14dbb-4d85-437c-b7cf-03ea3cfb4ba0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:24:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:26 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03 Sep 08 07:24:26 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:26 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03" returned: 0 in 0.431s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:26 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03 Sep 08 07:24:26 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Flow 'volume_create_manager' (4ece34e8-a9f4-4e42-89e0-104a6f75910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1b63d0-d99f-4543-8f5d-9063d458e69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1b63d0-d99f-4543-8f5d-9063d458e69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-18471215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe86b170-653c-476e-bc52-4445863fe830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b0a11622b04caab7741b8ae218e5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:26Z,use_quota=True,user_id='d35fc2a8bd604ce8895014e8f9319eb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c2f09b-9334-4f66-9da2-c97117438eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c2f09b-9334-4f66-9da2-c97117438eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa358b0-e356-424e-911a-636273cdbea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa358b0-e356-424e-911a-636273cdbea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe86b170-653c-476e-bc52-4445863fe830', 'volume_name': 'volume-fe86b170-653c-476e-bc52-4445863fe830', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef6a766-8a89-47a5-aff8-41f8b06a168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef6a766-8a89-47a5-aff8-41f8b06a168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4600e2e7-75bd-43c2-907c-4b91fb210201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Volume fe86b170-653c-476e-bc52-4445863fe830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe86b170-653c-476e-bc52-4445863fe830', 'volume_size': 1} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-18471215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe86b170-653c-476e-bc52-4445863fe830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b0a11622b04caab7741b8ae218e5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:26Z,use_quota=True,user_id='d35fc2a8bd604ce8895014e8f9319eb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Creating volume fe86b170-653c-476e-bc52-4445863fe830 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:24:26 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:26 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830 1073741824 Sep 08 07:24:26 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:26 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ede67497-7e82-4452-b818-923092db3f03" returned: 0 in 0.313s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Lock "cinder-quobyte-ede67497-7e82-4452-b818-923092db3f03" released by "delete_volume" :: held 0.808s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Created reservations ['b8ab1da2-7cc8-4ac8-9463-c0016a59c899', '210325f1-1229-4571-a0c5-96f763c779f9', '227ab577-c2d9-4f72-9fe4-b6d37a8de576', 'f202fa7f-6451-48c7-a49c-dba91723aa1b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:26 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:24:26 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:27 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830 1073741824" returned: 0 in 0.748s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:27 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.560s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:24:27 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830 Sep 08 07:24:27 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Deleted volume successfully. Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cec881c-0297-4112-bf88-eee4a782bf98 tempest-VolumesMetadataTest-2086633804 None] Lock "cinder-ede67497-7e82-4452-b818-923092db3f03-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:27 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830" returned: 0 in 0.309s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4600e2e7-75bd-43c2-907c-4b91fb210201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe86b170-653c-476e-bc52-4445863fe830', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b2b5ce-d434-4f8d-9b0d-2047c92968ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Volume volume-fe86b170-653c-476e-bc52-4445863fe830 (fe86b170-653c-476e-bc52-4445863fe830): created successfully Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b2b5ce-d434-4f8d-9b0d-2047c92968ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Flow 'volume_create_manager' (4ece34e8-a9f4-4e42-89e0-104a6f75910c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4b3a98dd-d8b2-43d1-956a-10a9dec7becd tempest-AttachVolumeNegativeTest-1601447696 None] Created volume successfully. Sep 08 07:24:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-731c7129-673d-4895-b4d3-4494704bb450 req-ea98ed95-2932-48e4-a128-9461d4258fd2 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-731c7129-673d-4895-b4d3-4494704bb450 req-ea98ed95-2932-48e4-a128-9461d4258fd2 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-731c7129-673d-4895-b4d3-4494704bb450 req-ea98ed95-2932-48e4-a128-9461d4258fd2 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-731c7129-673d-4895-b4d3-4494704bb450 req-ea98ed95-2932-48e4-a128-9461d4258fd2 tempest-AttachVolumeNegativeTest-1601447696 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-fe86b170-653c-476e-bc52-4445863fe830', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f2542e3-6873-4316-9261-b28fba3c89d0', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:24:29 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-731c7129-673d-4895-b4d3-4494704bb450 req-ea98ed95-2932-48e4-a128-9461d4258fd2 tempest-AttachVolumeNegativeTest-1601447696 None] attachment_update completed successfully. Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Flow 'volume_create_manager' (3e389894-a6cc-43ee-84a9-0a968568ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e1495e-05b1-49a9-a596-83993e7b47f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e1495e-05b1-49a9-a596-83993e7b47f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-361909301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46fd0cd-9231-4ffc-b714-1392070392f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a518638648a746d8bb983db84d06fcf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:35Z,use_quota=True,user_id='29863723ebe342fd933aadc56a48a8ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faa5f07-8731-4010-881e-d017cec62af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faa5f07-8731-4010-881e-d017cec62af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb0ce6f-de1e-456d-a1b6-b5f353b57a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb0ce6f-de1e-456d-a1b6-b5f353b57a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46fd0cd-9231-4ffc-b714-1392070392f2', 'volume_name': 'volume-a46fd0cd-9231-4ffc-b714-1392070392f2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ebbeaa-f533-4ac7-9ef2-ef4aab0ad2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ebbeaa-f533-4ac7-9ef2-ef4aab0ad2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16bf8fc-65d1-4b6e-8f86-b200aa4e9172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:34 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Volume a46fd0cd-9231-4ffc-b714-1392070392f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46fd0cd-9231-4ffc-b714-1392070392f2', 'volume_size': 1} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-361909301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46fd0cd-9231-4ffc-b714-1392070392f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a518638648a746d8bb983db84d06fcf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:35Z,use_quota=True,user_id='29863723ebe342fd933aadc56a48a8ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Creating volume a46fd0cd-9231-4ffc-b714-1392070392f2 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:24:34 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:24:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:34 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2 1073741824 Sep 08 07:24:34 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:35 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2 1073741824" returned: 0 in 0.775s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:35 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2 Sep 08 07:24:35 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:36 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2" returned: 0 in 0.369s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:24:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16bf8fc-65d1-4b6e-8f86-b200aa4e9172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46fd0cd-9231-4ffc-b714-1392070392f2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59822d1f-ae08-4060-8582-84d6b307691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:36 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Volume volume-a46fd0cd-9231-4ffc-b714-1392070392f2 (a46fd0cd-9231-4ffc-b714-1392070392f2): created successfully Sep 08 07:24:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59822d1f-ae08-4060-8582-84d6b307691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Flow 'volume_create_manager' (3e389894-a6cc-43ee-84a9-0a968568ce22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:36 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6004b851-b304-4277-b1c3-72e5a784c2db tempest-VolumesTransfersV355Test-1938674865 None] Created volume successfully. Sep 08 07:24:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-773237bb-59a9-4dce-89c3-fa8e4a11e876 tempest-VolumesTransfersV355Test-1628819841 None] Transfer volume completed successfully. Sep 08 07:24:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Acquiring lock "cinder-a46fd0cd-9231-4ffc-b714-1392070392f2-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Lock "cinder-a46fd0cd-9231-4ffc-b714-1392070392f2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Acquiring lock "cinder-quobyte-a46fd0cd-9231-4ffc-b714-1392070392f2" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Lock "cinder-quobyte-a46fd0cd-9231-4ffc-b714-1392070392f2" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:39 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[292c20b9-b4b3-4d51-839f-cd8867204261]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:24:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:39 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2 Sep 08 07:24:39 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:39 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2" returned: 0 in 0.440s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:39 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2 Sep 08 07:24:39 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a46fd0cd-9231-4ffc-b714-1392070392f2" returned: 0 in 0.275s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:40 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Lock "cinder-quobyte-a46fd0cd-9231-4ffc-b714-1392070392f2" released by "delete_volume" :: held 0.771s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:40 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Created reservations ['578539fa-6cb8-4149-a1e5-d561ca3c4e8e', 'a245f423-76e8-4bd5-8146-86242eeb3bbe', '965db91b-358f-44ce-a18b-5ec6b2c26709', 'b462fc80-c3a6-47fd-b410-09ea7e68e0e1'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:24:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:40 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:24:40 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:41 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.756s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:41 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:24:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Deleted volume successfully. Sep 08 07:24:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a958a270-fb6b-42d8-a42d-e63070fd6fc4 tempest-VolumesTransfersV355Test-1234894876 None] Lock "cinder-a46fd0cd-9231-4ffc-b714-1392070392f2-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-c857ff85-aa2d-41e8-bc3b-dd1768307e27 req-34af5635-90f3-4eed-9fc5-5d6d357a9ad5 tempest-AttachVolumeTestJSON-1462399904 None] Terminate volume connection completed successfully. Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-c857ff85-aa2d-41e8-bc3b-dd1768307e27 req-34af5635-90f3-4eed-9fc5-5d6d357a9ad5 tempest-AttachVolumeTestJSON-1462399904 None] Deleting attachment a79b4e69-664c-4667-8c4c-4508ac670b9f. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Flow 'volume_create_manager' (114ab595-8922-4b7d-9138-c685a0da8187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de819a50-b633-4133-8874-459b1ba043d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de819a50-b633-4133-8874-459b1ba043d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1332288233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5562153-c84d-4454-b5e6-9f787600e695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a518638648a746d8bb983db84d06fcf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:42Z,use_quota=True,user_id='29863723ebe342fd933aadc56a48a8ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab892393-9182-4458-86d1-d7a87e2ff755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab892393-9182-4458-86d1-d7a87e2ff755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a0bc1b-2dc4-4749-9acf-cab00f4939bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a0bc1b-2dc4-4749-9acf-cab00f4939bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5562153-c84d-4454-b5e6-9f787600e695', 'volume_name': 'volume-d5562153-c84d-4454-b5e6-9f787600e695', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86ff97a-0e66-458f-9d42-a44438d82eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86ff97a-0e66-458f-9d42-a44438d82eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3c2b09-f7ae-40ed-915e-a640880e4ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:42 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Volume d5562153-c84d-4454-b5e6-9f787600e695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5562153-c84d-4454-b5e6-9f787600e695', 'volume_size': 1} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1332288233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5562153-c84d-4454-b5e6-9f787600e695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a518638648a746d8bb983db84d06fcf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:24:42Z,use_quota=True,user_id='29863723ebe342fd933aadc56a48a8ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Creating volume d5562153-c84d-4454-b5e6-9f787600e695 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:24:42 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:24:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:42 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695 1073741824 Sep 08 07:24:42 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:44 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695 1073741824" returned: 0 in 1.542s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:44 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695 Sep 08 07:24:44 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:44 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:24:44 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:44 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695" returned: 0 in 0.599s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3c2b09-f7ae-40ed-915e-a640880e4ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5562153-c84d-4454-b5e6-9f787600e695', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24e590f-90e0-41fb-a592-6baa0f7a225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:24:45 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Volume volume-d5562153-c84d-4454-b5e6-9f787600e695 (d5562153-c84d-4454-b5e6-9f787600e695): created successfully Sep 08 07:24:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24e590f-90e0-41fb-a592-6baa0f7a225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:24:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Flow 'volume_create_manager' (114ab595-8922-4b7d-9138-c685a0da8187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:24:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-aa902875-3697-4a0b-b9ad-d4ed16c02e84 tempest-VolumesTransfersV355Test-1938674865 None] Created volume successfully. Sep 08 07:24:45 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.693s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:24:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:24:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:24:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:24:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Acquiring lock "cinder-d5562153-c84d-4454-b5e6-9f787600e695-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Lock "cinder-d5562153-c84d-4454-b5e6-9f787600e695-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Acquiring lock "cinder-quobyte-d5562153-c84d-4454-b5e6-9f787600e695" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:24:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Lock "cinder-quobyte-d5562153-c84d-4454-b5e6-9f787600e695" acquired by "delete_volume" :: waited 0.030s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:24:46 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d1a2b7-27e0-4d95-9570-c220e57abc6a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:24:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:47 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695 Sep 08 07:24:47 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:47 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695" returned: 0 in 0.633s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:47 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695 Sep 08 07:24:47 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:48 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d5562153-c84d-4454-b5e6-9f787600e695" returned: 0 in 0.557s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Lock "cinder-quobyte-d5562153-c84d-4454-b5e6-9f787600e695" released by "delete_volume" :: held 1.314s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:48 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Created reservations ['aa3859ed-7d1a-493e-80f3-7576f7f22fa2', '6977b4e9-4e8b-4859-80ef-afe80cace110', '65da0df4-0f03-4a89-a304-804267077ef8', '6fc8e612-633e-4087-9dc2-899fe45cf257'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:24:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:24:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:24:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:24:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:24:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:24:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:24:48 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:24:48 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:24:49 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 08 07:24:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.587s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:24:49 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:24:49 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Deleted volume successfully. Sep 08 07:24:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1542981f-91cc-49a0-b29e-af5302ab9f10 tempest-VolumesTransfersV355Test-1234894876 None] Lock "cinder-d5562153-c84d-4454-b5e6-9f787600e695-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:24:58 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=36,cinder:INSERT=10,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:24:59 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=36,cinder:SELECT=26,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Flow 'volume_create_manager' (37765ed9-baf4-42fa-89b2-4d24c91bc2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581e5429-bc21-4d73-b7cd-21f7870bec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581e5429-bc21-4d73-b7cd-21f7870bec59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2101609545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76dabab1-2a33-4dda-b6d5-b4db9ccbbfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085e6e27f8cc4d8582df34628b7b488a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:01Z,use_quota=True,user_id='1080661431b24dcf916914c9062967ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee936db5-4b79-4fba-af4a-d9a617be71f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee936db5-4b79-4fba-af4a-d9a617be71f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74924d5b-6b3d-468c-9d46-67e5d79f73ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74924d5b-6b3d-468c-9d46-67e5d79f73ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76dabab1-2a33-4dda-b6d5-b4db9ccbbfda', 'volume_name': 'volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace737bc-f4bb-487a-8757-9333cf33a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace737bc-f4bb-487a-8757-9333cf33a967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9ca514-94a0-4958-9edc-344b8887525e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:01 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Volume 76dabab1-2a33-4dda-b6d5-b4db9ccbbfda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda', 'volume_size': 1} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2101609545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76dabab1-2a33-4dda-b6d5-b4db9ccbbfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085e6e27f8cc4d8582df34628b7b488a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:01Z,use_quota=True,user_id='1080661431b24dcf916914c9062967ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Creating volume 76dabab1-2a33-4dda-b6d5-b4db9ccbbfda {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:25:01 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:25:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:01 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda 1073741824 Sep 08 07:25:01 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:02 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda 1073741824" returned: 0 in 0.950s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:02 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda Sep 08 07:25:02 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:02 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda" returned: 0 in 0.468s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:25:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9ca514-94a0-4958-9edc-344b8887525e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b129b0b-f4d0-4a44-8292-1dc2177b6ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:02 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Volume volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda (76dabab1-2a33-4dda-b6d5-b4db9ccbbfda): created successfully Sep 08 07:25:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b129b0b-f4d0-4a44-8292-1dc2177b6ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Flow 'volume_create_manager' (37765ed9-baf4-42fa-89b2-4d24c91bc2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:02 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0317408e-f60d-4cf7-bf6d-845e8d835002 tempest-ServerRescueNegativeTestJSON-1024188467 None] Created volume successfully. Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Flow 'volume_create_manager' (3a430f94-9497-4c9d-8f47-1f1b3ef5c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae5e2e6-12b0-47df-a118-a14bbc34bb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae5e2e6-12b0-47df-a118-a14bbc34bb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1048724378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c05fb120b8464d9b90593a3f7c1bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:06Z,use_quota=True,user_id='3ef95b747c7641c197c2386e6b70f036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b45ad9-7784-4e01-ac01-73c0480c3805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b45ad9-7784-4e01-ac01-73c0480c3805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a07c1c5-cd1b-413b-8991-fb0eea96548c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a07c1c5-cd1b-413b-8991-fb0eea96548c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4', 'volume_name': 'volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2040f948-4b96-4a3a-b46d-6d6b5e352aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2040f948-4b96-4a3a-b46d-6d6b5e352aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f2907c-70c5-45d0-947d-934cf20068ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:06 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Volume 1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4', 'volume_size': 1} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1048724378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c05fb120b8464d9b90593a3f7c1bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:06Z,use_quota=True,user_id='3ef95b747c7641c197c2386e6b70f036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Creating volume 1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:25:06 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:06 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 1073741824 Sep 08 07:25:06 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:06 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 1073741824" returned: 0 in 0.705s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:07 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 Sep 08 07:25:07 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:07 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4" returned: 0 in 0.336s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:25:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f2907c-70c5-45d0-947d-934cf20068ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62442e9f-26a0-4bd7-adf6-c1ebefe5597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:07 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Volume volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 (1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4): created successfully Sep 08 07:25:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62442e9f-26a0-4bd7-adf6-c1ebefe5597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Flow 'volume_create_manager' (3a430f94-9497-4c9d-8f47-1f1b3ef5c611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:07 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-11dada05-6f61-468e-af65-7b8675cd7cbf tempest-VolumesCloneTest-1009070470 None] Created volume successfully. Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Flow 'volume_create_manager' (66caf6ef-734d-4418-a3a2-a6651b32a739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab4bd43-cd0d-4aae-a7f4-3b522b5628d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab4bd43-cd0d-4aae-a7f4-3b522b5628d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1843184817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacc7fe7-952d-429c-bd72-23172b8b850f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c05fb120b8464d9b90593a3f7c1bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:09Z,use_quota=True,user_id='3ef95b747c7641c197c2386e6b70f036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8d6a8f-207a-44ce-878c-a7069ca88d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8d6a8f-207a-44ce-878c-a7069ca88d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2cc845-a359-4e7c-834f-14857924bb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2cc845-a359-4e7c-834f-14857924bb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cacc7fe7-952d-429c-bd72-23172b8b850f', 'volume_name': 'volume-cacc7fe7-952d-429c-bd72-23172b8b850f', 'volume_size': 2, 'source_volid': '1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4', 'source_volstatus': 'available'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fcc93e-aacb-4ca9-a4f4-a1c48655d775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fcc93e-aacb-4ca9-a4f4-a1c48655d775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2402455d-d320-4229-981a-cef2775f5bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:09 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Volume cacc7fe7-952d-429c-bd72-23172b8b850f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cacc7fe7-952d-429c-bd72-23172b8b850f', 'volume_size': 2, 'source_volid': '1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4', 'source_volstatus': 'available'} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:09 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Cloning volume 1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 to volume cacc7fe7-952d-429c-bd72-23172b8b850f Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Creating offline snapshot 22b1876f-f3c8-4fce-be9c-cad5cb8287dc of volume 1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1abdb0-6640-4935-b69d-3037cb774515]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:09 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 Sep 08 07:25:09 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:10 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4" returned: 0 in 0.615s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:10 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc 1G Sep 08 07:25:10 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:10 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc 1G" returned: 0 in 0.674s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:11 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc Sep 08 07:25:11 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:11 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc" returned: 0 in 0.376s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:11 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc is being set with open permissions: ugo+rw Sep 08 07:25:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:11 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc Sep 08 07:25:11 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:11 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc" returned: 0 in 0.282s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:11 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.info Sep 08 07:25:11 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:11 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.info" returned: 0 in 0.313s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:11 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.info is being set with open permissions: ugo+rw Sep 08 07:25:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:12 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.info Sep 08 07:25:12 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:12 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.info" returned: 0 in 0.395s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Acquiring lock "cinder-quobyte-cacc7fe7-952d-429c-bd72-23172b8b850f" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Lock "cinder-quobyte-cacc7fe7-952d-429c-bd72-23172b8b850f" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] snapshot: 22b1876f-f3c8-4fce-be9c-cad5cb8287dc, volume: cacc7fe7-952d-429c-bd72-23172b8b850f, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1685652e-7f18-4593-8d59-40155783dd56]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:12 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc Sep 08 07:25:12 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:13 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc" returned: 0 in 0.543s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:25:13 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[106cba2e-fed0-4249-a316-5f81115da8bd]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:13 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 Sep 08 07:25:13 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:13 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4" returned: 0 in 0.464s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:25:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:25:13 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:25:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:13 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f Sep 08 07:25:13 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Acquiring lock "cinder-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "cinder-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Acquiring lock "cinder-quobyte-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "cinder-quobyte-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda" acquired by "delete_volume" :: waited 0.129s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:14 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7ff21-893d-43dd-bf4b-9c6b76cdc663]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:15 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda Sep 08 07:25:15 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:17 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda" returned: 0 in 2.281s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:17 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda Sep 08 07:25:17 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:18 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda" returned: 0 in 1.038s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "cinder-quobyte-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda" released by "delete_volume" :: held 3.575s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:18 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Created reservations ['d480bd64-7513-4368-b0fe-c72dd1081e1d', '766c8e30-f140-4f4b-bbee-8d0f86974369', '8c02160e-1c70-4f37-8cde-39bc21442441', '79bbfc13-9885-42f0-bf56-3ab7b1e73137'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:25:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:19 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:25:19 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:19 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.723s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:19 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:25:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Deleted volume successfully. Sep 08 07:25:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5619c75a-08f8-4ff9-b356-1984215785ce tempest-ServerRescueNegativeTestJSON-1024188467 None] Lock "cinder-76dabab1-2a33-4dda-b6d5-b4db9ccbbfda-delete_volume" released by "delete_volume" :: held 5.482s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:24 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f" returned: 0 in 10.539s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4, size 1024.00 MB, duration 10.54 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:25:24 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Converted 1024.00 MB image at 97.16 MB/s Sep 08 07:25:24 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f is being set with open permissions: ugo+rw Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:24 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f Sep 08 07:25:24 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:24 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f" returned: 0 in 0.348s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Lock "cinder-quobyte-cacc7fe7-952d-429c-bd72-23172b8b850f" released by "_copy_volume_from_snapshot" :: held 11.990s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Acquiring lock "cinder-quobyte-22b1876f-f3c8-4fce-be9c-cad5cb8287dc" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Lock "cinder-quobyte-22b1876f-f3c8-4fce-be9c-cad5cb8287dc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Deleting offline snapshot 22b1876f-f3c8-4fce-be9c-cad5cb8287dc of volume 1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] snapshot_file for this snap is: volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb868b2-1d2d-439a-bb93-9420b1208ee9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:24 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc Sep 08 07:25:24 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:25 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc" returned: 0 in 0.516s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:25:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[91280285-567f-42d4-81f0-59970638a806]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:25 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 Sep 08 07:25:25 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:26 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4" returned: 0 in 1.176s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:26 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc Sep 08 07:25:26 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:27 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc" returned: 0 in 0.734s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:27 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc Sep 08 07:25:27 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:27 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4.22b1876f-f3c8-4fce-be9c-cad5cb8287dc" returned: 0 in 0.322s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Lock "cinder-quobyte-22b1876f-f3c8-4fce-be9c-cad5cb8287dc" released by "_delete_snapshot" :: held 2.927s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.943s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2402455d-d320-4229-981a-cef2775f5bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cacc7fe7-952d-429c-bd72-23172b8b850f', 'volume_size': 2, 'source_volid': '1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4', 'source_volstatus': 'available'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb1bc02-f2f6-41d1-89fb-cfada1cab755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Volume volume-cacc7fe7-952d-429c-bd72-23172b8b850f (cacc7fe7-952d-429c-bd72-23172b8b850f): created successfully Sep 08 07:25:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb1bc02-f2f6-41d1-89fb-cfada1cab755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Flow 'volume_create_manager' (66caf6ef-734d-4418-a3a2-a6651b32a739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b3d815f3-3875-444e-9bbb-4ec9b7c92ae0 tempest-VolumesCloneTest-1009070470 None] Created volume successfully. Sep 08 07:25:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Acquiring lock "cinder-cacc7fe7-952d-429c-bd72-23172b8b850f-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Lock "cinder-cacc7fe7-952d-429c-bd72-23172b8b850f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Acquiring lock "cinder-quobyte-cacc7fe7-952d-429c-bd72-23172b8b850f" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Lock "cinder-quobyte-cacc7fe7-952d-429c-bd72-23172b8b850f" acquired by "delete_volume" :: waited 0.028s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:28 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[116af319-b688-4f05-890f-412c5f461412]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:28 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f Sep 08 07:25:28 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:29 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f" returned: 0 in 0.450s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:29 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f Sep 08 07:25:29 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:29 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-cacc7fe7-952d-429c-bd72-23172b8b850f" returned: 0 in 0.370s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Lock "cinder-quobyte-cacc7fe7-952d-429c-bd72-23172b8b850f" released by "delete_volume" :: held 0.879s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Created reservations ['2bb994d8-87b3-40fe-8061-b4704228c7bb', '9e24f79f-0553-4ec9-aed0-46d09c728c55', '07835c41-2e3c-4795-8592-65d6f2fb5c70', 'b64102e8-a149-4962-8454-b2f44fb71d82'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:29 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:25:29 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Acquiring lock "cinder-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Lock "cinder-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:29 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.320s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Acquiring lock "cinder-quobyte-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:29 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Deleted volume successfully. Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4a976754-1dfc-4b5c-a265-e28fcc7a01c5 tempest-VolumesCloneTest-1009070470 None] Lock "cinder-cacc7fe7-952d-429c-bd72-23172b8b850f-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Lock "cinder-quobyte-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4" acquired by "delete_volume" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f5f04d-32d5-4457-8c64-214153c81b2a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:30 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 Sep 08 07:25:30 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:30 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4" returned: 0 in 0.483s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:30 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4 Sep 08 07:25:30 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:30 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4" returned: 0 in 0.277s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Lock "cinder-quobyte-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4" released by "delete_volume" :: held 0.838s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Created reservations ['0d72ebf2-a6f9-4667-9c3f-020c6eedd8b7', '8a451ab9-0833-40f3-b7b6-f158b5872dfa', '6e4a04e4-4287-45d5-8252-bf660b7cf7bb', 'a60aa79f-9cf2-4644-8c8b-f92d96b998a2'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:30 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:25:30 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-f97058a1-80ab-41f4-849f-5f3bb3fcce40 req-2c829852-3f1c-4c30-9880-ab6308763bb1 tempest-AttachVolumeNegativeTest-1601447696 None] Terminate volume connection completed successfully. Sep 08 07:25:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-f97058a1-80ab-41f4-849f-5f3bb3fcce40 req-2c829852-3f1c-4c30-9880-ab6308763bb1 tempest-AttachVolumeNegativeTest-1601447696 None] Deleting attachment 2f2542e3-6873-4316-9261-b28fba3c89d0. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:25:31 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.348s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:31 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:25:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Deleted volume successfully. Sep 08 07:25:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05b9060f-d8a1-4fc9-ad3b-701ecc78db3f tempest-VolumesCloneTest-1009070470 None] Lock "cinder-1ee0a1e3-039e-4788-be7e-2d27f6c2c7c4-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Flow 'volume_create_manager' (0da23461-d5a8-4258-aa7e-81cbc716e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2b5522-f056-4d57-8750-0363870b4681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2b5522-f056-4d57-8750-0363870b4681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-214824824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2630c105-8161-430d-abb1-2e958ce91ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3ef6e46dee46b392b16ba1af322729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:37Z,use_quota=True,user_id='f370aa8388c54bf0a20f499c54f9cdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae3b0ef-379a-4f29-b7b4-04e9f892fdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae3b0ef-379a-4f29-b7b4-04e9f892fdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea540361-004d-41a4-9643-06a705004962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea540361-004d-41a4-9643-06a705004962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2630c105-8161-430d-abb1-2e958ce91ab9', 'volume_name': 'volume-2630c105-8161-430d-abb1-2e958ce91ab9', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ede072-748c-4fbe-bf67-16e3899f55d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ede072-748c-4fbe-bf67-16e3899f55d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078248c1-ebbd-49bc-87b7-aabfffea6233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:37 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Volume 2630c105-8161-430d-abb1-2e958ce91ab9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2630c105-8161-430d-abb1-2e958ce91ab9', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 07:25:37 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Trying to clone 2630c105-8161-430d-abb1-2e958ce91ab9 from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:25:38 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:25:38 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Image download 20.69 MB at 20.69 MB/s Sep 08 07:25:38 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5d69f-e511-4580-9744-410fc95145e7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:38 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD Sep 08 07:25:38 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:38 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:38 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 is fetched for user f370aa8388c54bf0a20f499c54f9cdeb. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[77948783-4cf2-4cdc-9e58-3a86ab918916]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:39 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD Sep 08 07:25:39 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:39 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-214824824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2630c105-8161-430d-abb1-2e958ce91ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3ef6e46dee46b392b16ba1af322729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:37Z,use_quota=True,user_id='f370aa8388c54bf0a20f499c54f9cdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Creating volume 2630c105-8161-430d-abb1-2e958ce91ab9 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:25:39 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:25:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:39 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 1073741824 Sep 08 07:25:39 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:40 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 1073741824" returned: 0 in 0.587s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:40 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 Sep 08 07:25:40 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f771ce8e-5a80-4f8e-952b-5d338b3b42bc tempest-GroupSnapshotsTest-1689214778 None] Group tempest-GroupSnapshotsTest-Group-570604984: creating Sep 08 07:25:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f771ce8e-5a80-4f8e-952b-5d338b3b42bc tempest-GroupSnapshotsTest-1689214778 None] Group tempest-GroupSnapshotsTest-Group-570604984: created successfully Sep 08 07:25:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f771ce8e-5a80-4f8e-952b-5d338b3b42bc tempest-GroupSnapshotsTest-1689214778 None] Create group completed successfully. Sep 08 07:25:40 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9" returned: 0 in 0.292s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Attempting download of cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume 2630c105-8161-430d-abb1-2e958ce91ab9. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a864801-a52a-491c-a8ed-ce30b6e9e51c]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_ms1qqxbi {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:40 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_ms1qqxbi Sep 08 07:25:40 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:40 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_ms1qqxbi" returned: 0 in 0.348s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_ms1qqxbi {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:41 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_ms1qqxbi Sep 08 07:25:41 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:41 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_ms1qqxbi" returned: 1 in 0.349s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_ms1qqxbi' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:25:41 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb234f2c-e381-473d-9914-749b54d75c72]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:41 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD Sep 08 07:25:41 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:41 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:41 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 was qcow2, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:25:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:41 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 Sep 08 07:25:41 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Flow 'volume_create_manager' (29f88fa9-19f1-4420-9762-da01c25a48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c09bf75-b9c5-4a0d-b064-6912b0371f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c09bf75-b9c5-4a0d-b064-6912b0371f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960323834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f10eeec-3c85-4935-a6ab-9d9f2b091cea,host='devstack@QuobyteHD#QuobyteHD',id=d59457de-02f0-4dc4-be6c-5e4932315e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b6ffa5236d4d589210101e8a01e34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:42Z,use_quota=True,user_id='c58599201fe24994b7230c98db35d68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b0fe5d7-ff19-4284-b207-e37b1f351128),volume_type_id=2b0fe5d7-ff19-4284-b207-e37b1f351128)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a454d1a9-1076-47c0-a556-dcd0ae238007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a454d1a9-1076-47c0-a556-dcd0ae238007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2227b4c9-ff62-468a-ac47-d1ef1cdad97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2227b4c9-ff62-468a-ac47-d1ef1cdad97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd59457de-02f0-4dc4-be6c-5e4932315e43', 'volume_name': 'volume-d59457de-02f0-4dc4-be6c-5e4932315e43', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5da54ba-f207-4438-8cca-3ebaa1760d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5da54ba-f207-4438-8cca-3ebaa1760d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e807234-fdbd-42a0-b65b-e8687a7064c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:42 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Volume d59457de-02f0-4dc4-be6c-5e4932315e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d59457de-02f0-4dc4-be6c-5e4932315e43', 'volume_size': 1} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f10eeec-3c85-4935-a6ab-9d9f2b091cea,created_at=2026-09-08T05:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960323834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f10eeec-3c85-4935-a6ab-9d9f2b091cea,host='devstack@QuobyteHD#QuobyteHD',id=d59457de-02f0-4dc4-be6c-5e4932315e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b6ffa5236d4d589210101e8a01e34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:42Z,use_quota=True,user_id='c58599201fe24994b7230c98db35d68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b0fe5d7-ff19-4284-b207-e37b1f351128),volume_type_id=2b0fe5d7-ff19-4284-b207-e37b1f351128)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Creating volume d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:25:42 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:25:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:42 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 1073741824 Sep 08 07:25:42 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:43 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 1073741824" returned: 0 in 0.672s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:43 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 Sep 08 07:25:43 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:43 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43" returned: 0 in 0.512s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:25:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e807234-fdbd-42a0-b65b-e8687a7064c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d59457de-02f0-4dc4-be6c-5e4932315e43', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feee2c89-8cb2-44b4-9221-9c813247fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:43 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Volume volume-d59457de-02f0-4dc4-be6c-5e4932315e43 (d59457de-02f0-4dc4-be6c-5e4932315e43): created successfully Sep 08 07:25:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feee2c89-8cb2-44b4-9221-9c813247fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Flow 'volume_create_manager' (29f88fa9-19f1-4420-9762-da01c25a48a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:43 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6384ae1d-87bc-403b-946d-edfc3b86cacd tempest-GroupSnapshotsTest-1689214778 None] Created volume successfully. Sep 08 07:25:44 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9" returned: 0 in 2.493s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_dgr3psmxdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:25:44 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Converted 112.00 MB image at 44.90 MB/s Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:44 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 1G Sep 08 07:25:44 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:44 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 1G" returned: 0 in 0.438s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Downloaded image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume 2630c105-8161-430d-abb1-2e958ce91ab9 successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:25:44 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:25:44 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 for user f370aa8388c54bf0a20f499c54f9cdeb is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Marking volume 2630c105-8161-430d-abb1-2e958ce91ab9 as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Copying metadata from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 to 2630c105-8161-430d-abb1-2e958ce91ab9. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Creating volume glance metadata for volume 2630c105-8161-430d-abb1-2e958ce91ab9 backed by image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078248c1-ebbd-49bc-87b7-aabfffea6233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2630c105-8161-430d-abb1-2e958ce91ab9', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc1d71c-c9c6-4406-b647-3fcc47622d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:44 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Volume volume-2630c105-8161-430d-abb1-2e958ce91ab9 (2630c105-8161-430d-abb1-2e958ce91ab9): created successfully Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc1d71c-c9c6-4406-b647-3fcc47622d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:44 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Flow 'volume_create_manager' (0da23461-d5a8-4258-aa7e-81cbc716e149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.351s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:25:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:25:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f978b9e2-d260-4a5a-b330-1eda810c7670 tempest-VolumesExtendTest-1460080700 None] Created volume successfully. Sep 08 07:25:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] GroupSnapshot 4423f7c3-47ba-485f-88d0-652cc21a8ca5: creating. Sep 08 07:25:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Group snapshot 4423f7c3-47ba-485f-88d0-652cc21a8ca5: creating. {{(pid=87278) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 07:25:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Creating offline snapshot 1583631d-2969-44fb-beab-00f544da009d of volume d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:25:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fbba84-149d-4180-9245-a73e9eaf9420]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:45 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 Sep 08 07:25:45 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:45 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43" returned: 0 in 0.436s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:45 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d 1G Sep 08 07:25:45 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a7e30486-4541-4f03-bd1a-bc580c12083e tempest-VolumesExtendTest-1460080700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:46 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d 1G" returned: 0 in 0.514s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d59457de-02f0-4dc4-be6c-5e4932315e43 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:46 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d59457de-02f0-4dc4-be6c-5e4932315e43 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d Sep 08 07:25:46 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:46 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d59457de-02f0-4dc4-be6c-5e4932315e43 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:46 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:25:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:46 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d Sep 08 07:25:46 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:46 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d" returned: 0 in 0.308s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:46 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.info Sep 08 07:25:46 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:47 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.info" returned: 0 in 0.344s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:47 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:25:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:47 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.info Sep 08 07:25:47 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:47 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.info" returned: 0 in 0.595s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a7e30486-4541-4f03-bd1a-bc580c12083e tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.812s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:47 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad8157d-aab7-43f5-a494-f5aa4546138a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7e30486-4541-4f03-bd1a-bc580c12083e tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-29deba2d-3dd0-449f-a4ac-4414563ba32d tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 4423f7c3-47ba-485f-88d0-652cc21a8ca5: created successfully Sep 08 07:25:48 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 Sep 08 07:25:48 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:48 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7e30486-4541-4f03-bd1a-bc580c12083e tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9" returned: 0 in 0.986s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7e30486-4541-4f03-bd1a-bc580c12083e tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 2G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7e30486-4541-4f03-bd1a-bc580c12083e tempest-VolumesExtendTest-1460080700 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 2G" returned: 0 in 0.197s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a7e30486-4541-4f03-bd1a-bc580c12083e tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.243s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:49 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a7e30486-4541-4f03-bd1a-bc580c12083e tempest-VolumesExtendTest-1460080700 None] Extend volume completed successfully. Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-1583631d-2969-44fb-beab-00f544da009d-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" by "_create_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-1583631d-2969-44fb-beab-00f544da009d-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Creating volume b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d from snapshot 1583631d-2969-44fb-beab-00f544da009d {{(pid=87278) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] snapshot: 1583631d-2969-44fb-beab-00f544da009d, volume: b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aef52dd-d151-436f-af8d-12c2300ea540]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "cinder-2630c105-8161-430d-abb1-2e958ce91ab9-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:50 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d Sep 08 07:25:50 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-2630c105-8161-430d-abb1-2e958ce91ab9-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "cinder-quobyte-2630c105-8161-430d-abb1-2e958ce91ab9" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-quobyte-2630c105-8161-430d-abb1-2e958ce91ab9" acquired by "delete_volume" :: waited 0.030s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d949e-f22f-47d7-aa07-be375125cef6]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:50 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 Sep 08 07:25:50 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:51 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d" returned: 0 in 0.905s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d59457de-02f0-4dc4-be6c-5e4932315e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20e2e82-e488-4f7b-a15c-4576f883c0f0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:51 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9" returned: 0 in 0.553s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:51 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 Sep 08 07:25:51 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:51 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9 Sep 08 07:25:51 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:51 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43" returned: 0 in 0.598s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:51 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2630c105-8161-430d-abb1-2e958ce91ab9" returned: 0 in 0.431s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:51 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d Sep 08 07:25:51 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-quobyte-2630c105-8161-430d-abb1-2e958ce91ab9" released by "delete_volume" :: held 1.063s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Created reservations ['e55650fb-c430-4450-8719-9beb570f63fa', 'baea5921-52c7-4d7c-a522-6fcb2abd7395', '19d92ab9-1428-4f90-ad62-b7fbeb4966f3', '4c5d3cfb-dfa7-4bc8-8a74-982bc942b79c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:25:52 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:25:52 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:25:52 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.380s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:25:52 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Deleted volume successfully. Sep 08 07:25:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-37bc4010-3b2e-4d27-aae3-916bc8c9ea63 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-2630c105-8161-430d-abb1-2e958ce91ab9-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:25:55 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:25:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Flow 'volume_create_manager' (de28bfc7-74aa-467f-aa53-06ddc6108301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:25:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1d107b-c2bc-4fea-8770-d22542ea2bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1d107b-c2bc-4fea-8770-d22542ea2bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2076435827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfc2518-5479-433e-9da6-896d87c6a427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3ef6e46dee46b392b16ba1af322729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:56Z,use_quota=True,user_id='f370aa8388c54bf0a20f499c54f9cdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1947c494-b211-4cd8-bcd4-e70c3fc62a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1947c494-b211-4cd8-bcd4-e70c3fc62a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a812f57-58d7-44ff-aa95-5a759350637f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a812f57-58d7-44ff-aa95-5a759350637f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bfc2518-5479-433e-9da6-896d87c6a427', 'volume_name': 'volume-7bfc2518-5479-433e-9da6-896d87c6a427', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d414bc93-fe4a-4105-adc8-83c5eba0913b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d414bc93-fe4a-4105-adc8-83c5eba0913b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:25:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16471d33-6ac1-47c5-a15a-71019893262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:25:56 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Volume 7bfc2518-5479-433e-9da6-896d87c6a427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bfc2518-5479-433e-9da6-896d87c6a427', 'volume_size': 1} Sep 08 07:25:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:01 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" returned: 0 in 9.381s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43, size 1024.00 MB, duration 9.38 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:26:01 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Converted 1024.00 MB image at 109.15 MB/s Sep 08 07:26:01 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:01 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d Sep 08 07:26:01 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:01 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" returned: 0 in 0.736s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" released by "_copy_volume_from_snapshot" :: held 11.825s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=53,cinder:UPDATE=56,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=58,cinder:INSERT=13,cinder:SELECT=57,cinder:DELETE=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-1583631d-2969-44fb-beab-00f544da009d-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" released by "_create_volume_from_snapshot" :: held 11.950s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.994s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.719s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2076435827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfc2518-5479-433e-9da6-896d87c6a427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3ef6e46dee46b392b16ba1af322729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:25:56Z,use_quota=True,user_id='f370aa8388c54bf0a20f499c54f9cdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Creating volume 7bfc2518-5479-433e-9da6-896d87c6a427 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:02 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:02 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 1073741824 Sep 08 07:26:02 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:02 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f538daf5-df53-4c43-8770-7319333b9250 tempest-GroupSnapshotsTest-1689214778 None] Create group from source-snapshot-4423f7c3-47ba-485f-88d0-652cc21a8ca5 completed successfully. Sep 08 07:26:02 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 1073741824" returned: 0 in 0.647s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:02 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 Sep 08 07:26:02 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[56073c39-8b64-4b5c-9afb-d54d2ba863e0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:02 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427" returned: 0 in 0.293s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16471d33-6ac1-47c5-a15a-71019893262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bfc2518-5479-433e-9da6-896d87c6a427', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f24da06-1fbf-4b3c-a136-c2f284d892e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:03 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Volume volume-7bfc2518-5479-433e-9da6-896d87c6a427 (7bfc2518-5479-433e-9da6-896d87c6a427): created successfully Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f24da06-1fbf-4b3c-a136-c2f284d892e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Flow 'volume_create_manager' (de28bfc7-74aa-467f-aa53-06ddc6108301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:03 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ba51a05d-ea35-43dd-899c-eaceb3216418 tempest-VolumesExtendTest-1460080700 None] Created volume successfully. Sep 08 07:26:03 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d Sep 08 07:26:03 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:03 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" returned: 0 in 0.454s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:03 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d Sep 08 07:26:03 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:03 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" returned: 0 in 0.268s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-b67198cb-c9ea-4c86-b9e6-4f9a28f88b3d" released by "delete_volume" :: held 0.793s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['123f6889-ae9d-4b3b-a214-5786c4df6afe'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:03 devstack cinder-volume[87278]: WARNING cinder.quota [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-495908969 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-495908969, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:03 devstack cinder-volume[87278]: WARNING cinder.quota [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-495908969 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-495908969, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:03 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['bb24468f-9326-472e-87ff-d2a253287ef1', '9f8cea96-7110-4635-aed3-529f5d99e907', '90b47805-361a-4eb0-9228-f0006b1bb808', '8e22a4d7-a7e5-4010-841c-1e16ae36de19'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Creating offline snapshot 38f36613-434b-42a9-9872-9571bfe5fcd4 of volume 7bfc2518-5479-433e-9da6-896d87c6a427 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:26:04 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:04 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e90084f-0d59-4708-a307-2d9a997b4c88]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:04 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 Sep 08 07:26:04 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 4423f7c3-47ba-485f-88d0-652cc21a8ca5: deleting Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 4423f7c3-47ba-485f-88d0-652cc21a8ca5: deleting {{(pid=87278) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-d59457de-02f0-4dc4-be6c-5e4932315e43" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-d59457de-02f0-4dc4-be6c-5e4932315e43" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-1583631d-2969-44fb-beab-00f544da009d" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:04 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.509s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5ead36c8-9631-4020-84ed-622279ba7b79 tempest-GroupSnapshotsTest-1689214778 None] Delete group completed successfully. Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-1583631d-2969-44fb-beab-00f544da009d" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Deleting offline snapshot 1583631d-2969-44fb-beab-00f544da009d of volume d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] snapshot_file for this snap is: volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9516c692-db2c-4ac0-9374-3355a08960ac]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:04 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d Sep 08 07:26:04 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:04 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427" returned: 0 in 0.714s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:04 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 1G Sep 08 07:26:04 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:05 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d" returned: 0 in 0.502s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d59457de-02f0-4dc4-be6c-5e4932315e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e30bee-98e5-432c-8e41-f9aa8431a7e3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:05 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 1G" returned: 0 in 0.483s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bfc2518-5479-433e-9da6-896d87c6a427 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:05 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 Sep 08 07:26:05 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:05 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bfc2518-5479-433e-9da6-896d87c6a427 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 Sep 08 07:26:05 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:05 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bfc2518-5479-433e-9da6-896d87c6a427 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4" returned: 0 in 0.309s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:05 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 is being set with open permissions: ugo+rw Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:05 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 Sep 08 07:26:05 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:05 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43" returned: 0 in 0.609s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:05 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d Sep 08 07:26:05 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:05 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4" returned: 0 in 0.264s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:05 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.info Sep 08 07:26:05 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:06 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d" returned: 0 in 0.359s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:06 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d Sep 08 07:26:06 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:06 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.info" returned: 0 in 0.290s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:06 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.info is being set with open permissions: ugo+rw Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:06 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.info Sep 08 07:26:06 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:06 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43.1583631d-2969-44fb-beab-00f544da009d" returned: 0 in 0.249s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-1583631d-2969-44fb-beab-00f544da009d" released by "_delete_snapshot" :: held 1.847s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-d59457de-02f0-4dc4-be6c-5e4932315e43" released by "delete_snapshot" :: held 1.909s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:06 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.info" returned: 0 in 0.264s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:06 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4ed80ada-aa5b-4972-9759-1b2560b63282 tempest-VolumesExtendTest-1460080700 None] Create snapshot completed successfully Sep 08 07:26:06 devstack cinder-volume[87278]: WARNING cinder.quota [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-495908969 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-495908969, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:06 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['7126adec-6c29-43fb-9175-d72401c58a39', 'fdf77293-fb76-4b2f-aac7-d988ad83fc1e', 'a777e921-f66a-4dbe-8070-0b09b634795d', '8367d377-0ecd-4804-88b1-314d5ee0599f'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:06 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f323461e-8551-4732-b859-ea183be08013 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 4423f7c3-47ba-485f-88d0-652cc21a8ca5: deleted successfully Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-d59457de-02f0-4dc4-be6c-5e4932315e43" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-d59457de-02f0-4dc4-be6c-5e4932315e43" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27d8ce5-adc7-419d-b9b8-b8ecd74ea24d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:07 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 Sep 08 07:26:07 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1951fd62-9477-44d2-b542-b5c7a867205f tempest-VolumesExtendTest-1460080700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1951fd62-9477-44d2-b542-b5c7a867205f tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6faff51-271c-46c4-bb6e-9bc8e50fa51c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1951fd62-9477-44d2-b542-b5c7a867205f tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:07 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 Sep 08 07:26:07 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:07 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43" returned: 0 in 0.414s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:07 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43 Sep 08 07:26:07 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:07 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1951fd62-9477-44d2-b542-b5c7a867205f tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427" returned: 0 in 0.402s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1951fd62-9477-44d2-b542-b5c7a867205f tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 2G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:07 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d59457de-02f0-4dc4-be6c-5e4932315e43" returned: 0 in 0.271s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-d59457de-02f0-4dc4-be6c-5e4932315e43" released by "delete_volume" :: held 0.760s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:07 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['6328b1db-2609-4dbb-ab75-66a66a8fc4a3'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1951fd62-9477-44d2-b542-b5c7a867205f tempest-VolumesExtendTest-1460080700 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 2G" returned: 0 in 0.147s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1951fd62-9477-44d2-b542-b5c7a867205f tempest-VolumesExtendTest-1460080700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.589s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:08 devstack cinder-volume[87278]: WARNING cinder.db.api [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-495908969'] Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['3b24b5e7-abc1-49f3-a34f-e18b6c743406', '1aa9c3c7-fc68-4302-ade7-eddb9478f3a0', '6345dc33-e1ca-45cc-ac6f-c88172e23498', '52c837ef-5562-4e37-ab6e-7b51a9bf35d5'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:08 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1951fd62-9477-44d2-b542-b5c7a867205f tempest-VolumesExtendTest-1460080700 None] Extend volume completed successfully. Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:08 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:08 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:08 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.252s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:08 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d7e59549-84e2-45b6-90ca-17afdc5f3191 tempest-GroupSnapshotsTest-1689214778 None] Delete group completed successfully. Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "cinder-38f36613-434b-42a9-9872-9571bfe5fcd4-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-38f36613-434b-42a9-9872-9571bfe5fcd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "cinder-quobyte-7bfc2518-5479-433e-9da6-896d87c6a427" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-quobyte-7bfc2518-5479-433e-9da6-896d87c6a427" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "cinder-quobyte-38f36613-434b-42a9-9872-9571bfe5fcd4" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-quobyte-38f36613-434b-42a9-9872-9571bfe5fcd4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Deleting offline snapshot 38f36613-434b-42a9-9872-9571bfe5fcd4 of volume 7bfc2518-5479-433e-9da6-896d87c6a427 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] snapshot_file for this snap is: volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b65d3c-7e93-42dc-add7-31b43e7bdeb3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:08 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2dc06891-3b9d-4d97-a77f-54d3bf166746 tempest-GroupSnapshotsTest-1689214778 None] Group tempest-GroupSnapshotsTest-Group-948640904: creating Sep 08 07:26:08 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2dc06891-3b9d-4d97-a77f-54d3bf166746 tempest-GroupSnapshotsTest-1689214778 None] Group tempest-GroupSnapshotsTest-Group-948640904: created successfully Sep 08 07:26:08 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2dc06891-3b9d-4d97-a77f-54d3bf166746 tempest-GroupSnapshotsTest-1689214778 None] Create group completed successfully. Sep 08 07:26:09 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 Sep 08 07:26:09 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:09 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4" returned: 0 in 0.442s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bfc2518-5479-433e-9da6-896d87c6a427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:26:09 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e413cdb-e8bf-4cee-9266-fd8fbd0fdb48]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:09 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 Sep 08 07:26:09 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:09 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427" returned: 0 in 0.364s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:09 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 Sep 08 07:26:09 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:10 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4" returned: 0 in 0.384s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:10 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4 Sep 08 07:26:10 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:10 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427.38f36613-434b-42a9-9872-9571bfe5fcd4" returned: 0 in 0.339s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-quobyte-38f36613-434b-42a9-9872-9571bfe5fcd4" released by "_delete_snapshot" :: held 1.716s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-quobyte-7bfc2518-5479-433e-9da6-896d87c6a427" released by "delete_snapshot" :: held 1.762s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:10 devstack cinder-volume[87278]: WARNING cinder.quota [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Created reservations ['6c7d90a4-81e9-499a-935c-e01224db8c2e', '67e77aff-7316-4eb4-ac5f-4c9d03f845fd', '2f78c0ee-1ba0-4ddf-a166-afffb2ea34bb', '70d7b30e-d534-4caa-8de9-e8350164b604'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:10 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Delete snapshot completed successfully. Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Flow 'volume_create_manager' (539b4d34-9431-41d2-b5ee-2e89651eae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866f3db7-eaf0-426b-9c2b-46e88a1a071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3774ebb2-2433-4183-b65e-9980e47b6f26 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-38f36613-434b-42a9-9872-9571bfe5fcd4-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866f3db7-eaf0-426b-9c2b-46e88a1a071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-810464838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ebe27aa-07ea-4439-8cea-fb68414e42e5,host='devstack@QuobyteHD#QuobyteHD',id=fcc99243-2c7d-45dd-8256-a83aa1874fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b6ffa5236d4d589210101e8a01e34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:11Z,use_quota=True,user_id='c58599201fe24994b7230c98db35d68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(394d7624-654d-4add-b339-38f413e39f90),volume_type_id=394d7624-654d-4add-b339-38f413e39f90)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f69dea-4a03-4570-8e13-8e00ea4aafe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f69dea-4a03-4570-8e13-8e00ea4aafe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b388c43e-f746-4ed4-a152-19891f1142ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b388c43e-f746-4ed4-a152-19891f1142ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc99243-2c7d-45dd-8256-a83aa1874fc4', 'volume_name': 'volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a053326-409d-4b39-8e9d-f5e37c411246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a053326-409d-4b39-8e9d-f5e37c411246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5b840e-791e-44e6-a4a0-780a6cf73be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:10 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Volume fcc99243-2c7d-45dd-8256-a83aa1874fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4', 'volume_size': 1} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ebe27aa-07ea-4439-8cea-fb68414e42e5,created_at=2026-09-08T05:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-810464838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ebe27aa-07ea-4439-8cea-fb68414e42e5,host='devstack@QuobyteHD#QuobyteHD',id=fcc99243-2c7d-45dd-8256-a83aa1874fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b6ffa5236d4d589210101e8a01e34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:11Z,use_quota=True,user_id='c58599201fe24994b7230c98db35d68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(394d7624-654d-4add-b339-38f413e39f90),volume_type_id=394d7624-654d-4add-b339-38f413e39f90)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Creating volume fcc99243-2c7d-45dd-8256-a83aa1874fc4 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:10 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:10 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 1073741824 Sep 08 07:26:10 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "cinder-7bfc2518-5479-433e-9da6-896d87c6a427-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-7bfc2518-5479-433e-9da6-896d87c6a427-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "cinder-quobyte-7bfc2518-5479-433e-9da6-896d87c6a427" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-quobyte-7bfc2518-5479-433e-9da6-896d87c6a427" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[552f2290-6bd3-4ce0-9c97-cec782b7e24e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:11 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 Sep 08 07:26:11 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:11 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 1073741824" returned: 0 in 0.496s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:11 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 Sep 08 07:26:11 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:11 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427" returned: 0 in 0.419s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:11 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427 Sep 08 07:26:11 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:11 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7bfc2518-5479-433e-9da6-896d87c6a427" returned: 0 in 0.281s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-quobyte-7bfc2518-5479-433e-9da6-896d87c6a427" released by "delete_volume" :: held 0.771s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:11 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4" returned: 0 in 0.494s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5b840e-791e-44e6-a4a0-780a6cf73be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dbdb4e-3025-4818-96a1-a446ac7f87f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:11 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Volume volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 (fcc99243-2c7d-45dd-8256-a83aa1874fc4): created successfully Sep 08 07:26:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dbdb4e-3025-4818-96a1-a446ac7f87f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Flow 'volume_create_manager' (539b4d34-9431-41d2-b5ee-2e89651eae6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:12 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-430d6136-94c9-480f-b804-c1cb84105140 tempest-GroupSnapshotsTest-1689214778 None] Created volume successfully. Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Created reservations ['2810e1c0-f086-45e8-ab3d-25d2372fb7b5', 'eaf48a89-22d8-4cd0-90a8-ecb31053b685', '5d269b42-057d-4492-928c-0d050daacf28', '0d1458c6-9293-4c05-adf6-c209fb556ca4'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:12 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:12 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:12 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.271s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:12 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Deleted volume successfully. Sep 08 07:26:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e476552-3611-45f3-9714-2521aa5b6302 tempest-VolumesExtendTest-1460080700 None] Lock "cinder-7bfc2518-5479-433e-9da6-896d87c6a427-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:13 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Flow 'volume_create_manager' (9f963997-a69a-44b0-a2e0-79ebf0635c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc3e816-9c7b-4cc9-a5cd-bc689d85fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc3e816-9c7b-4cc9-a5cd-bc689d85fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794818720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ebe27aa-07ea-4439-8cea-fb68414e42e5,host='devstack@QuobyteHD#QuobyteHD',id=669b489c-ab52-41bc-981e-859ed2e012d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b6ffa5236d4d589210101e8a01e34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:14Z,use_quota=True,user_id='c58599201fe24994b7230c98db35d68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(394d7624-654d-4add-b339-38f413e39f90),volume_type_id=394d7624-654d-4add-b339-38f413e39f90)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d318f9-0940-4128-b204-a9dbd62cc3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d318f9-0940-4128-b204-a9dbd62cc3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b5a037-9231-41cd-a89b-19a3fcaf7756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b5a037-9231-41cd-a89b-19a3fcaf7756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669b489c-ab52-41bc-981e-859ed2e012d4', 'volume_name': 'volume-669b489c-ab52-41bc-981e-859ed2e012d4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8510ed4-147c-4e85-bac6-880330f01d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8510ed4-147c-4e85-bac6-880330f01d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84b63b6-1ce4-4f25-b89a-7c94502a296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Volume 669b489c-ab52-41bc-981e-859ed2e012d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669b489c-ab52-41bc-981e-859ed2e012d4', 'volume_size': 1} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ebe27aa-07ea-4439-8cea-fb68414e42e5,created_at=2026-09-08T05:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794818720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ebe27aa-07ea-4439-8cea-fb68414e42e5,host='devstack@QuobyteHD#QuobyteHD',id=669b489c-ab52-41bc-981e-859ed2e012d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b6ffa5236d4d589210101e8a01e34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:14Z,use_quota=True,user_id='c58599201fe24994b7230c98db35d68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(394d7624-654d-4add-b339-38f413e39f90),volume_type_id=394d7624-654d-4add-b339-38f413e39f90)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Creating volume 669b489c-ab52-41bc-981e-859ed2e012d4 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:14 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:14 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 1073741824 Sep 08 07:26:14 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:14 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 1073741824" returned: 0 in 0.468s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:14 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 Sep 08 07:26:14 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:14 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4" returned: 0 in 0.258s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84b63b6-1ce4-4f25-b89a-7c94502a296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669b489c-ab52-41bc-981e-859ed2e012d4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7949b9da-3456-4773-83c9-871663538259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Volume volume-669b489c-ab52-41bc-981e-859ed2e012d4 (669b489c-ab52-41bc-981e-859ed2e012d4): created successfully Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7949b9da-3456-4773-83c9-871663538259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Flow 'volume_create_manager' (9f963997-a69a-44b0-a2e0-79ebf0635c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a30e9956-9357-4f04-9deb-a79f71c1904c tempest-GroupSnapshotsTest-1689214778 None] Created volume successfully. Sep 08 07:26:15 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-aff0b79c-10af-4b28-ae7f-45e085779cd6 tempest-GroupSnapshotsTest-1689214778 None] Update group completed successfully. Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (4026a35c-6245-401c-9697-40be2b4902a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dad83bb-a3fc-4f8d-9491-9913357a2e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dad83bb-a3fc-4f8d-9491-9913357a2e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-681705842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:16Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605faebd-50ba-4221-996e-935b7baa684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605faebd-50ba-4221-996e-935b7baa684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c117470-baae-401a-8daf-d1933118ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c117470-baae-401a-8daf-d1933118ec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3', 'volume_name': 'volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be04be6-5b15-4eb6-b9c2-039764928fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be04be6-5b15-4eb6-b9c2-039764928fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5d01c9-1fd8-443c-83fe-f4eafaece543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Volume 8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3', 'volume_size': 1} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-681705842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:16Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Creating volume 8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:16 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:16 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 1073741824 Sep 08 07:26:16 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:16 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-922969c3-4431-4fc7-99fd-472e8f7de73e tempest-GroupSnapshotsTest-1689214778 None] Update group completed successfully. Sep 08 07:26:16 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 1073741824" returned: 0 in 0.501s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:16 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 Sep 08 07:26:16 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:16 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3" returned: 0 in 0.265s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5d01c9-1fd8-443c-83fe-f4eafaece543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8527641-5c91-4534-9725-0c6246040ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Volume volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 (8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3): created successfully Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8527641-5c91-4534-9725-0c6246040ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (4026a35c-6245-401c-9697-40be2b4902a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3893cd34-398e-402b-bd01-bd04abc7f02f tempest-VolumesGetTest-106567064 None] Created volume successfully. Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Flow 'volume_create_manager' (542772db-d20a-44ea-85e8-e2de11b71e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98df5e5d-73ad-4390-bbc6-e43cec1675b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98df5e5d-73ad-4390-bbc6-e43cec1675b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-916853153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6499b6-b52f-4e23-a735-97643e662efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b0a11622b04caab7741b8ae218e5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:17Z,use_quota=True,user_id='d35fc2a8bd604ce8895014e8f9319eb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e1db3f-9a97-43e2-a6ed-bc29ba0e3f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e1db3f-9a97-43e2-a6ed-bc29ba0e3f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00da720b-41f2-4c39-9fd6-83c5150549e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00da720b-41f2-4c39-9fd6-83c5150549e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6499b6-b52f-4e23-a735-97643e662efe', 'volume_name': 'volume-3e6499b6-b52f-4e23-a735-97643e662efe', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73877fbe-6ad7-4575-8e8c-6a57fbb38e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73877fbe-6ad7-4575-8e8c-6a57fbb38e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfffe25b-2bed-468a-bbed-e376be56fb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Volume 3e6499b6-b52f-4e23-a735-97643e662efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6499b6-b52f-4e23-a735-97643e662efe', 'volume_size': 1} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-916853153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6499b6-b52f-4e23-a735-97643e662efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b0a11622b04caab7741b8ae218e5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:17Z,use_quota=True,user_id='d35fc2a8bd604ce8895014e8f9319eb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Creating volume 3e6499b6-b52f-4e23-a735-97643e662efe {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:17 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:17 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe 1073741824 Sep 08 07:26:17 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:17 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe 1073741824" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9856f816-11ff-4543-b478-cf265705478c tempest-GroupSnapshotsTest-1689214778 None] Update group completed successfully. Sep 08 07:26:17 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe Sep 08 07:26:17 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:17 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfffe25b-2bed-468a-bbed-e376be56fb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6499b6-b52f-4e23-a735-97643e662efe', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc462293-d993-4885-be2f-5d15e711ff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Volume volume-3e6499b6-b52f-4e23-a735-97643e662efe (3e6499b6-b52f-4e23-a735-97643e662efe): created successfully Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc462293-d993-4885-be2f-5d15e711ff00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Flow 'volume_create_manager' (542772db-d20a-44ea-85e8-e2de11b71e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-784b91e4-319c-40d3-aa60-c8b0f8b2d0a8 tempest-AttachVolumeNegativeTest-1601447696 None] Created volume successfully. Sep 08 07:26:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-058e10b9-6e08-46bf-afe2-9dcbdca7c30d tempest-GroupSnapshotsTest-1689214778 None] Update group completed successfully. Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (88584828-951b-4f74-bc9d-9992774bfa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2978bfec-4c8b-4165-b559-9608dbb01c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2978bfec-4c8b-4165-b559-9608dbb01c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1375007717',display_name='tempest-VolumesGetTest-Volume-1026638717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafbcdb0-a403-450d-a6fe-528f262b70b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:19Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e875ffe-262a-4990-ae69-fae71d29f764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e875ffe-262a-4990-ae69-fae71d29f764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f89977-ff45-49c1-b454-a9e590550e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f89977-ff45-49c1-b454-a9e590550e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fafbcdb0-a403-450d-a6fe-528f262b70b9', 'volume_name': 'volume-fafbcdb0-a403-450d-a6fe-528f262b70b9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a60141-1327-4dc0-a59a-ff40a9e691cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a60141-1327-4dc0-a59a-ff40a9e691cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244ae5be-e0ca-4ce5-a347-ab4d70693268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:19 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Volume fafbcdb0-a403-450d-a6fe-528f262b70b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fafbcdb0-a403-450d-a6fe-528f262b70b9', 'volume_size': 1} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1375007717',display_name='tempest-VolumesGetTest-Volume-1026638717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafbcdb0-a403-450d-a6fe-528f262b70b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:19Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Creating volume fafbcdb0-a403-450d-a6fe-528f262b70b9 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:19 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:19 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 1073741824 Sep 08 07:26:19 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-b28a350a-9697-414b-8377-28b6ca9c7b5a req-e84ab107-a226-427c-b396-dcb2e3d23fd6 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:19 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 1073741824" returned: 0 in 0.473s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:19 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 Sep 08 07:26:19 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:20 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9" returned: 0 in 0.261s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-b28a350a-9697-414b-8377-28b6ca9c7b5a req-e84ab107-a226-427c-b396-dcb2e3d23fd6 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.733s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244ae5be-e0ca-4ce5-a347-ab4d70693268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fafbcdb0-a403-450d-a6fe-528f262b70b9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76a4c58-c2bd-4cb5-a898-df266d06fc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-b28a350a-9697-414b-8377-28b6ca9c7b5a req-e84ab107-a226-427c-b396-dcb2e3d23fd6 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:20 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Volume volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 (fafbcdb0-a403-450d-a6fe-528f262b70b9): created successfully Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76a4c58-c2bd-4cb5-a898-df266d06fc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (88584828-951b-4f74-bc9d-9992774bfa68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-53acf4c8-9847-4388-a423-af601230545d tempest-VolumesGetTest-106567064 None] Created volume successfully. Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-b28a350a-9697-414b-8377-28b6ca9c7b5a req-e84ab107-a226-427c-b396-dcb2e3d23fd6 tempest-AttachVolumeNegativeTest-1601447696 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-3e6499b6-b52f-4e23-a735-97643e662efe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c3d62e7-316e-45df-bc6e-5741b705e840', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:26:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-b28a350a-9697-414b-8377-28b6ca9c7b5a req-e84ab107-a226-427c-b396-dcb2e3d23fd6 tempest-AttachVolumeNegativeTest-1601447696 None] attachment_update completed successfully. Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-fafbcdb0-a403-450d-a6fe-528f262b70b9-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Lock "cinder-fafbcdb0-a403-450d-a6fe-528f262b70b9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-quobyte-fafbcdb0-a403-450d-a6fe-528f262b70b9" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-fafbcdb0-a403-450d-a6fe-528f262b70b9" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] GroupSnapshot 68447dc1-1a1b-4f4e-961a-f90b3a14b9c3: creating. Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[06939283-566e-4a92-82d9-06201569152b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Group snapshot 68447dc1-1a1b-4f4e-961a-f90b3a14b9c3: creating. {{(pid=87278) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Creating offline snapshot c1f02d44-5992-4ae3-99d5-3d17fcba4871 of volume fcc99243-2c7d-45dd-8256-a83aa1874fc4 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9b55b-5c77-41fb-b56a-fc0ba9dbb83e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:20 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 Sep 08 07:26:20 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:21 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 Sep 08 07:26:21 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:21 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9" returned: 0 in 0.489s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:21 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9 Sep 08 07:26:21 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:21 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4" returned: 0 in 0.485s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:21 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 1G Sep 08 07:26:21 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:21 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fafbcdb0-a403-450d-a6fe-528f262b70b9" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-fafbcdb0-a403-450d-a6fe-528f262b70b9" released by "delete_volume" :: held 0.816s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Created reservations ['c5167a5c-1650-46bf-8b34-e9547a42ab5b', 'b82f6a51-8c24-4e69-9d5b-808b6ea7cf59', 'e745725e-50f0-49d7-a40b-99493b388a12', 'd45bbec1-707d-4072-8927-fddb7e425a12'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:21 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:21 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:21 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 1G" returned: 0 in 0.445s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:21 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 Sep 08 07:26:21 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Lock "cinder-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:21 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.293s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-quobyte-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:21 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Deleted volume successfully. Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7e035748-03bf-4238-8b88-ba69397e5b04 tempest-VolumesGetTest-106567064 None] Lock "cinder-fafbcdb0-a403-450d-a6fe-528f262b70b9-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fbf6cc-234f-457a-b2b9-a3b327c2a126]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:22 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 Sep 08 07:26:22 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:22 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871" returned: 0 in 0.340s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:22 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:22 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 Sep 08 07:26:22 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:22 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3" returned: 0 in 0.400s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:22 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3 Sep 08 07:26:22 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:22 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871" returned: 0 in 0.263s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:22 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.info Sep 08 07:26:22 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:22 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3" returned: 0 in 0.280s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3" released by "delete_volume" :: held 0.730s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Created reservations ['abbcb736-5d25-4c22-92ed-68ad901d3e0d', '77f30d53-3d2d-4102-86f0-ca5822dd3e45', 'c30e7dc4-2fb5-4772-8bb7-b4ab5b8a79d7', '691e6fea-7133-4b21-afac-fcd5b824f2dd'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:22 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.info" returned: 0 in 0.293s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:22 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:22 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.info Sep 08 07:26:22 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:22 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:22 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:23 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.info" returned: 0 in 0.364s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:23 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.313s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Creating offline snapshot fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 of volume 669b489c-ab52-41bc-981e-859ed2e012d4 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:26:23 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Deleted volume successfully. Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[452a61d4-a22d-45e0-a155-ff2bffc17da4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-abec0002-cc2a-43c2-9e59-60942f295995 tempest-VolumesGetTest-106567064 None] Lock "cinder-8ddc2c4e-be7c-42c3-a657-6fcfcdbb86b3-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:23 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-66db227d-5014-4b51-87c0-891981190cb9 req-ebbe08e9-5be5-40ee-a075-f15a33d82599 tempest-AttachVolumeNegativeTest-1601447696 None] Terminate volume connection completed successfully. Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-66db227d-5014-4b51-87c0-891981190cb9 req-ebbe08e9-5be5-40ee-a075-f15a33d82599 tempest-AttachVolumeNegativeTest-1601447696 None] Deleting attachment 3c3d62e7-316e-45df-bc6e-5741b705e840. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:26:23 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 Sep 08 07:26:23 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:23 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (606ce7f0-22cd-40ed-9096-715a360aa2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396487ae-fb99-4880-b417-0d8c4b8751b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4" returned: 0 in 0.493s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396487ae-fb99-4880-b417-0d8c4b8751b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1345974414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f453eea-1c7d-478b-a7c5-11188f6bbae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:24Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:23 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 1G Sep 08 07:26:23 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0028311-c5db-4586-91ef-e3a5d4ffbe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0028311-c5db-4586-91ef-e3a5d4ffbe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771f090e-31b5-42ad-9f1c-f5e575cb610f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771f090e-31b5-42ad-9f1c-f5e575cb610f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f453eea-1c7d-478b-a7c5-11188f6bbae5', 'volume_name': 'volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2e7933-5af4-45e2-aecd-9e9f73793d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2e7933-5af4-45e2-aecd-9e9f73793d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8e78ea-7944-4a18-8623-8d67a649aacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Volume 0f453eea-1c7d-478b-a7c5-11188f6bbae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5', 'volume_size': 1} Sep 08 07:26:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:24 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 1G" returned: 0 in 0.449s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669b489c-ab52-41bc-981e-859ed2e012d4 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:24 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669b489c-ab52-41bc-981e-859ed2e012d4 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 Sep 08 07:26:24 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:24 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669b489c-ab52-41bc-981e-859ed2e012d4 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8" returned: 0 in 0.354s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:24 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:26:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:24 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 Sep 08 07:26:24 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Flow 'volume_create_manager' (1eea4cee-a2d0-47ee-bb8c-5e546a70f2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43363f7d-92ff-4a5b-84ec-51c5b2bcae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:25 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8" returned: 0 in 0.538s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43363f7d-92ff-4a5b-84ec-51c5b2bcae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1452995927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e355aca0-c3df-4a1f-9043-e84e9c215ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91aa7d30d6949b78e89097f66d64043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:25Z,use_quota=True,user_id='13c19a52f64f484891c1f42a123bffba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67c8e85-4d25-4b5d-920d-767ca2a33100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67c8e85-4d25-4b5d-920d-767ca2a33100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5001c4b1-dc12-4700-8315-f447a0d373c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5001c4b1-dc12-4700-8315-f447a0d373c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e355aca0-c3df-4a1f-9043-e84e9c215ebf', 'volume_name': 'volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ebaf1b-1b76-403d-9db9-9bd398ffd28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ebaf1b-1b76-403d-9db9-9bd398ffd28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514632f4-ef98-4014-b1c6-150bafa5940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:25 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Volume e355aca0-c3df-4a1f-9043-e84e9c215ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf', 'volume_size': 1} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:25 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.info Sep 08 07:26:25 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:25 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.info" returned: 0 in 0.274s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:25 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:25 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.info Sep 08 07:26:25 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:25 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.info" returned: 0 in 0.255s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1345974414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f453eea-1c7d-478b-a7c5-11188f6bbae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:24Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Creating volume 0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:25 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:25 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 1073741824 Sep 08 07:26:25 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:25 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-75c82c9f-3eaa-4988-867c-f5be1b5ca6a0 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 68447dc1-1a1b-4f4e-961a-f90b3a14b9c3: created successfully Sep 08 07:26:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 68447dc1-1a1b-4f4e-961a-f90b3a14b9c3: deleting Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 68447dc1-1a1b-4f4e-961a-f90b3a14b9c3: deleting {{(pid=87278) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 07:26:26 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 1073741824" returned: 0 in 0.658s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-fcc99243-2c7d-45dd-8256-a83aa1874fc4" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-fcc99243-2c7d-45dd-8256-a83aa1874fc4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-c1f02d44-5992-4ae3-99d5-3d17fcba4871" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-c1f02d44-5992-4ae3-99d5-3d17fcba4871" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Deleting offline snapshot c1f02d44-5992-4ae3-99d5-3d17fcba4871 of volume fcc99243-2c7d-45dd-8256-a83aa1874fc4 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:26:26 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 Sep 08 07:26:26 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] snapshot_file for this snap is: volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d04b03a-7e58-4721-895c-7686be6bb4d9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:26 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 Sep 08 07:26:26 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:26 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5" returned: 0 in 0.322s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1452995927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e355aca0-c3df-4a1f-9043-e84e9c215ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91aa7d30d6949b78e89097f66d64043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:25Z,use_quota=True,user_id='13c19a52f64f484891c1f42a123bffba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Creating volume e355aca0-c3df-4a1f-9043-e84e9c215ebf {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:26 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8e78ea-7944-4a18-8623-8d67a649aacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f41e8f-8c98-4bc3-9aca-13664df88ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:26 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf 1073741824 Sep 08 07:26:26 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Volume volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 (0f453eea-1c7d-478b-a7c5-11188f6bbae5): created successfully Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f41e8f-8c98-4bc3-9aca-13664df88ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (606ce7f0-22cd-40ed-9096-715a360aa2e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-64bdec2a-2a8e-4a8e-9d65-048eaff27ea9 tempest-VolumesGetTest-106567064 None] Created volume successfully. Sep 08 07:26:26 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871" returned: 0 in 0.492s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8648c1-0fb5-4565-aa96-e647bbd84800]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:27 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 Sep 08 07:26:27 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:27 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf 1073741824" returned: 0 in 0.598s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:27 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf Sep 08 07:26:27 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:27 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4" returned: 0 in 0.518s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:27 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 Sep 08 07:26:27 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:27 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (3b462728-28df-40b4-b5b4-084cb87467ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a55acf-65ef-4abd-abe5-a93e8177856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf" returned: 0 in 0.367s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a55acf-65ef-4abd-abe5-a93e8177856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-36027423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce81596-4038-4105-b289-3d4d715a7dfe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0f453eea-1c7d-478b-a7c5-11188f6bbae5,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:28Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e91158-791e-4271-a46c-54604190aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e91158-791e-4271-a46c-54604190aa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05938cf8-61e2-472f-937b-d7a9ecb40067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514632f4-ef98-4014-b1c6-150bafa5940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d53b6d-78a3-4c4a-a8d8-5cd3939430ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05938cf8-61e2-472f-937b-d7a9ecb40067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8ce81596-4038-4105-b289-3d4d715a7dfe', 'volume_name': 'volume-8ce81596-4038-4105-b289-3d4d715a7dfe', 'volume_size': 1, 'source_volid': '0f453eea-1c7d-478b-a7c5-11188f6bbae5', 'source_volstatus': 'available'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66f92c4-c2af-4105-b919-7f668fa13cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66f92c4-c2af-4105-b919-7f668fa13cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d372346-ba39-4f2b-b27d-e45f17af263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Volume 8ce81596-4038-4105-b289-3d4d715a7dfe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8ce81596-4038-4105-b289-3d4d715a7dfe', 'volume_size': 1, 'source_volid': '0f453eea-1c7d-478b-a7c5-11188f6bbae5', 'source_volstatus': 'available'} Sep 08 07:26:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Volume volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf (e355aca0-c3df-4a1f-9043-e84e9c215ebf): created successfully Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d53b6d-78a3-4c4a-a8d8-5cd3939430ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Flow 'volume_create_manager' (1eea4cee-a2d0-47ee-bb8c-5e546a70f2f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:27 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Cloning volume 0f453eea-1c7d-478b-a7c5-11188f6bbae5 to volume 8ce81596-4038-4105-b289-3d4d715a7dfe Sep 08 07:26:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4eba8f6a-9c23-458c-8a2c-28f21761e5af tempest-AttachVolumeTestJSON-1462399904 None] Created volume successfully. Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Creating offline snapshot e9f6ca46-433a-4fd0-8667-125701c2e131 of volume 0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aada748-6cf8-4dab-8b04-23d82f9024ae]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:27 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871" returned: 0 in 0.447s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:28 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871 Sep 08 07:26:28 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:28 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 Sep 08 07:26:28 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:28 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4.c1f02d44-5992-4ae3-99d5-3d17fcba4871" returned: 0 in 0.327s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-c1f02d44-5992-4ae3-99d5-3d17fcba4871" released by "_delete_snapshot" :: held 1.945s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-fcc99243-2c7d-45dd-8256-a83aa1874fc4" released by "delete_snapshot" :: held 2.003s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-669b489c-ab52-41bc-981e-859ed2e012d4" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-669b489c-ab52-41bc-981e-859ed2e012d4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-fb9cd03a-0627-41e4-bde0-452f5ed2b7c8" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-fb9cd03a-0627-41e4-bde0-452f5ed2b7c8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Deleting offline snapshot fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 of volume 669b489c-ab52-41bc-981e-859ed2e012d4 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:26:28 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] snapshot_file for this snap is: volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5" returned: 0 in 0.548s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c97f2a-66c8-4813-b5e7-2d9c78fde826]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:28 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 1G Sep 08 07:26:28 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:28 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 Sep 08 07:26:28 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:29 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8" returned: 0 in 0.524s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-669b489c-ab52-41bc-981e-859ed2e012d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a8c380-2f26-484c-a985-63c7a5f9b748]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-8b08e119-c80e-419e-8240-738a72a6a4c9 req-dcd44c86-dc0a-4658-b461-35db42ea5fbd tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:29 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 1G" returned: 0 in 0.668s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:29 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 Sep 08 07:26:29 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:29 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 Sep 08 07:26:29 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:29 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4" returned: 0 in 0.452s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:29 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131" returned: 0 in 0.376s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:29 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 is being set with open permissions: ugo+rw Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:29 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 Sep 08 07:26:29 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:29 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 Sep 08 07:26:29 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:29 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131" returned: 0 in 0.283s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:29 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.info Sep 08 07:26:29 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:29 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8" returned: 0 in 0.407s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:29 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8 Sep 08 07:26:29 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:30 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.info" returned: 0 in 0.297s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:30 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.info is being set with open permissions: ugo+rw Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:30 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.info Sep 08 07:26:30 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:30 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4.fb9cd03a-0627-41e4-bde0-452f5ed2b7c8" returned: 0 in 0.292s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-fb9cd03a-0627-41e4-bde0-452f5ed2b7c8" released by "_delete_snapshot" :: held 1.811s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-669b489c-ab52-41bc-981e-859ed2e012d4" released by "delete_snapshot" :: held 1.846s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:30 devstack cinder-volume[87278]: WARNING cinder.quota [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-145366523 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-145366523, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:30 devstack cinder-volume[87278]: WARNING cinder.quota [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-145366523 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-145366523, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['3a01f173-f2a2-424b-b2d5-0cca1656157d', '2ee67a40-e282-4df0-95c4-5df26095569a', '35d5030b-40d3-4315-8c83-549978cfc654', '28c4c0a3-7651-411a-8a4a-61d3706d4db9'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:30 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.info" returned: 0 in 0.293s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-quobyte-8ce81596-4038-4105-b289-3d4d715a7dfe" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-8ce81596-4038-4105-b289-3d4d715a7dfe" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] snapshot: e9f6ca46-433a-4fd0-8667-125701c2e131, volume: 8ce81596-4038-4105-b289-3d4d715a7dfe, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[564c8e58-0313-4eef-9c43-ece679920a0d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['d260e0be-a791-4414-8102-aa3ba5bf41f3', 'de083912-df9b-4f14-8443-4ec47cc198ba', '8be4eaad-2e87-4993-abce-91e8d299cd5f', 'fa3c2b11-03b0-4196-b67e-aa35a87ee0c5'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:30 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 Sep 08 07:26:30 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:30 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d677d6bf-b91e-4eec-9f32-2369157ae667 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 68447dc1-1a1b-4f4e-961a-f90b3a14b9c3: deleted successfully Sep 08 07:26:30 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131" returned: 0 in 0.416s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16ef6fe-b0fe-41ed-93ba-6f9a64c3bdf0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:31 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 Sep 08 07:26:31 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-669b489c-ab52-41bc-981e-859ed2e012d4" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-669b489c-ab52-41bc-981e-859ed2e012d4" acquired by "delete_volume" :: waited 0.028s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:31 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5" returned: 0 in 0.437s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56f153d-ffb9-48a8-a90c-abf4f6fac74b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:31 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe Sep 08 07:26:31 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:31 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 Sep 08 07:26:31 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:31 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4" returned: 0 in 0.451s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:31 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4 Sep 08 07:26:31 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:32 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-669b489c-ab52-41bc-981e-859ed2e012d4" returned: 0 in 0.450s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-669b489c-ab52-41bc-981e-859ed2e012d4" released by "delete_volume" :: held 1.071s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-fcc99243-2c7d-45dd-8256-a83aa1874fc4" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-fcc99243-2c7d-45dd-8256-a83aa1874fc4" acquired by "delete_volume" :: waited 0.064s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:32 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccf55d3-2c3c-4da6-b3c3-a42f2623742f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:32 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 Sep 08 07:26:32 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:33 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4" returned: 0 in 1.038s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:33 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4 Sep 08 07:26:33 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:34 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fcc99243-2c7d-45dd-8256-a83aa1874fc4" returned: 0 in 1.044s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-fcc99243-2c7d-45dd-8256-a83aa1874fc4" released by "delete_volume" :: held 2.265s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['e8412e43-bf82-4fc0-b48b-65b0b3deaf82'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:35 devstack cinder-volume[87278]: WARNING cinder.quota [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-145366523 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-145366523, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:35 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['ded77ace-76e8-4e45-8a22-5c1b1db91388', '2b62c16f-0754-4e59-968f-ace229a6605e', '9ce1af00-700e-4c46-8992-ec82c3bb164f', 'b43b56c6-e0f0-4ed4-9bd1-4d5948fdb9c3'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:35 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['b24f16ae-0570-4775-8eab-c3d7e22e8419', '9986ddff-39a9-4935-ba6b-5f4e9af3f082', 'b2c5054b-076d-4954-b35a-7fd541c721df', 'f5f2fd37-4516-448a-8a75-82e0a33621fa'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:36 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:36 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:36 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.745s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:36 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:36 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2dd07243-650d-4aa2-afa4-2f4ec766adfd tempest-GroupSnapshotsTest-1689214778 None] Delete group completed successfully. Sep 08 07:26:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-43df38d5-d0b0-4479-8c19-1b6ae74f526f tempest-GroupSnapshotsTest-1689214778 None] Group tempest-GroupSnapshotsTest-Group-1296156238: creating Sep 08 07:26:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-43df38d5-d0b0-4479-8c19-1b6ae74f526f tempest-GroupSnapshotsTest-1689214778 None] Group tempest-GroupSnapshotsTest-Group-1296156238: created successfully Sep 08 07:26:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-43df38d5-d0b0-4479-8c19-1b6ae74f526f tempest-GroupSnapshotsTest-1689214778 None] Create group completed successfully. Sep 08 07:26:37 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe" returned: 0 in 6.313s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:37 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:26:37 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Converted 1024.00 MB image at 162.19 MB/s Sep 08 07:26:37 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe is being set with open permissions: ugo+rw Sep 08 07:26:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:37 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe Sep 08 07:26:37 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:37 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe" returned: 0 in 0.249s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-8ce81596-4038-4105-b289-3d4d715a7dfe" released by "_copy_volume_from_snapshot" :: held 7.490s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-quobyte-e9f6ca46-433a-4fd0-8667-125701c2e131" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-e9f6ca46-433a-4fd0-8667-125701c2e131" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Deleting offline snapshot e9f6ca46-433a-4fd0-8667-125701c2e131 of volume 0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] snapshot_file for this snap is: volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c919b4-f57b-4cc7-b8df-26a3e0a3fcba]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:38 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 Sep 08 07:26:38 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:38 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131" returned: 0 in 0.384s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffea9a3-47b2-40fb-b65e-cf5b0130f4d2]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:38 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 Sep 08 07:26:38 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:39 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5" returned: 0 in 0.619s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:39 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 Sep 08 07:26:39 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Flow 'volume_create_manager' (73defff4-6ab2-4506-a80e-219f0df985c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616c772e-c36e-4ddc-9b1d-b2a51fea4767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:39 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131" returned: 0 in 0.795s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616c772e-c36e-4ddc-9b1d-b2a51fea4767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-623468776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf26262b-17ee-4e47-9771-a8bcebec6726,host='devstack@QuobyteHD#QuobyteHD',id=1a2639fd-d3de-4149-a38d-a93fbf342b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b6ffa5236d4d589210101e8a01e34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:40Z,use_quota=True,user_id='c58599201fe24994b7230c98db35d68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2583b1df-7879-4c2f-b200-0eec646a6835),volume_type_id=2583b1df-7879-4c2f-b200-0eec646a6835)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:39 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131 Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d748c9-1082-4f21-b509-1b7b5d0ec404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:39 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d748c9-1082-4f21-b509-1b7b5d0ec404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd09b95d-8f36-4038-8da1-ce6f6b02b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd09b95d-8f36-4038-8da1-ce6f6b02b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2639fd-d3de-4149-a38d-a93fbf342b0e', 'volume_name': 'volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c8379e-38e2-46bc-becb-884f0fd9e184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c8379e-38e2-46bc-becb-884f0fd9e184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3090f2-1a66-492d-8fb9-e3fb8d3fbc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:40 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Volume 1a2639fd-d3de-4149-a38d-a93fbf342b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e', 'volume_size': 1} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:40 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5.e9f6ca46-433a-4fd0-8667-125701c2e131" returned: 0 in 0.413s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-e9f6ca46-433a-4fd0-8667-125701c2e131" released by "_delete_snapshot" :: held 2.351s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.544s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-8b08e119-c80e-419e-8240-738a72a6a4c9 req-dcd44c86-dc0a-4658-b461-35db42ea5fbd tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.313s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-8b08e119-c80e-419e-8240-738a72a6a4c9 req-dcd44c86-dc0a-4658-b461-35db42ea5fbd tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf26262b-17ee-4e47-9771-a8bcebec6726,created_at=2026-09-08T05:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-623468776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf26262b-17ee-4e47-9771-a8bcebec6726,host='devstack@QuobyteHD#QuobyteHD',id=1a2639fd-d3de-4149-a38d-a93fbf342b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b6ffa5236d4d589210101e8a01e34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:40Z,use_quota=True,user_id='c58599201fe24994b7230c98db35d68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2583b1df-7879-4c2f-b200-0eec646a6835),volume_type_id=2583b1df-7879-4c2f-b200-0eec646a6835)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Creating volume 1a2639fd-d3de-4149-a38d-a93fbf342b0e {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:40 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:40 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e 1073741824 Sep 08 07:26:40 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d372346-ba39-4f2b-b27d-e45f17af263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce81596-4038-4105-b289-3d4d715a7dfe', 'volume_size': 1, 'source_volid': '0f453eea-1c7d-478b-a7c5-11188f6bbae5', 'source_volstatus': 'available'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9a9404-fe31-4533-91b1-a605bda36fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:40 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Volume volume-8ce81596-4038-4105-b289-3d4d715a7dfe (8ce81596-4038-4105-b289-3d4d715a7dfe): created successfully Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9a9404-fe31-4533-91b1-a605bda36fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (3b462728-28df-40b4-b5b4-084cb87467ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-8b08e119-c80e-419e-8240-738a72a6a4c9 req-dcd44c86-dc0a-4658-b461-35db42ea5fbd tempest-AttachVolumeTestJSON-1462399904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9500cdc4-0504-44c0-9f77-465240f770c9', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:26:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-642689b4-6a69-46a8-9862-9c9203d349ef tempest-VolumesGetTest-106567064 None] Created volume successfully. Sep 08 07:26:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-8b08e119-c80e-419e-8240-738a72a6a4c9 req-dcd44c86-dc0a-4658-b461-35db42ea5fbd tempest-AttachVolumeTestJSON-1462399904 None] attachment_update completed successfully. Sep 08 07:26:41 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e 1073741824" returned: 0 in 0.864s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:41 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e Sep 08 07:26:41 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:42 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e" returned: 0 in 0.578s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3090f2-1a66-492d-8fb9-e3fb8d3fbc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb1f2bf-53b6-4e8c-b253-60dc19f4d03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:42 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Volume volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e (1a2639fd-d3de-4149-a38d-a93fbf342b0e): created successfully Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb1f2bf-53b6-4e8c-b253-60dc19f4d03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Flow 'volume_create_manager' (73defff4-6ab2-4506-a80e-219f0df985c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-63148d79-6e42-4b52-b1b0-51b23ffa8759 tempest-GroupSnapshotsTest-1689214778 None] Created volume successfully. Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (ef772132-a6cb-44dd-9971-e2c42dcd4c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d50eee-e503-4f91-ab51-4a0b5c4cf36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d50eee-e503-4f91-ab51-4a0b5c4cf36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1729864958',display_name='tempest-VolumesGetTest-Volume-1720149410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45c69e3-c633-4e86-81ea-5ff4390d924d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:42Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a9cfd1-473c-43c2-b3fb-00e38945dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a9cfd1-473c-43c2-b3fb-00e38945dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441442af-de63-442f-afbd-800e386eb851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441442af-de63-442f-afbd-800e386eb851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd45c69e3-c633-4e86-81ea-5ff4390d924d', 'volume_name': 'volume-d45c69e3-c633-4e86-81ea-5ff4390d924d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee48d1d-ce64-4716-bc36-51c8ca500c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee48d1d-ce64-4716-bc36-51c8ca500c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa88a92-59f5-4780-8fdc-af46d2147adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:42 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Volume d45c69e3-c633-4e86-81ea-5ff4390d924d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d45c69e3-c633-4e86-81ea-5ff4390d924d', 'volume_size': 1} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1729864958',display_name='tempest-VolumesGetTest-Volume-1720149410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45c69e3-c633-4e86-81ea-5ff4390d924d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:42Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Creating volume d45c69e3-c633-4e86-81ea-5ff4390d924d {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:42 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:42 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d 1073741824 Sep 08 07:26:42 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:43 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d 1073741824" returned: 0 in 0.600s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:43 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d Sep 08 07:26:43 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Flow 'volume_create_manager' (3c3b9789-33ce-4ec2-87ca-3cdbe44be1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f18a086-0c6a-4d5e-8c95-ad71470d38ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f18a086-0c6a-4d5e-8c95-ad71470d38ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2067700173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e38f10-3b2e-44ce-8aaa-5eef96dca0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91aa7d30d6949b78e89097f66d64043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:43Z,use_quota=True,user_id='13c19a52f64f484891c1f42a123bffba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f686ee7-98b9-45ea-98cc-effd5b40081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f686ee7-98b9-45ea-98cc-effd5b40081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734d6ade-9a05-4dcc-b11e-0d6ccb03079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734d6ade-9a05-4dcc-b11e-0d6ccb03079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e38f10-3b2e-44ce-8aaa-5eef96dca0ca', 'volume_name': 'volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42afe00a-adf7-4d92-9dba-b531edab81b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42afe00a-adf7-4d92-9dba-b531edab81b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1922f599-a416-4763-98f1-0a12773cb857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:43 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Volume 08e38f10-3b2e-44ce-8aaa-5eef96dca0ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca', 'volume_size': 1} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:43 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d" returned: 0 in 0.338s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.053s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2067700173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e38f10-3b2e-44ce-8aaa-5eef96dca0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91aa7d30d6949b78e89097f66d64043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:43Z,use_quota=True,user_id='13c19a52f64f484891c1f42a123bffba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Creating volume 08e38f10-3b2e-44ce-8aaa-5eef96dca0ca {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:43 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa88a92-59f5-4780-8fdc-af46d2147adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d45c69e3-c633-4e86-81ea-5ff4390d924d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9eef29-5123-4d21-81dd-fb5dee026b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:43 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca 1073741824 Sep 08 07:26:43 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:43 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Volume volume-d45c69e3-c633-4e86-81ea-5ff4390d924d (d45c69e3-c633-4e86-81ea-5ff4390d924d): created successfully Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9eef29-5123-4d21-81dd-fb5dee026b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (ef772132-a6cb-44dd-9971-e2c42dcd4c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:43 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1aac1e04-f558-4881-9d08-73e131991180 tempest-VolumesGetTest-106567064 None] Created volume successfully. Sep 08 07:26:43 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] GroupSnapshot 19be79da-5258-4c22-b620-ad6923a74762: creating. Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Group snapshot 19be79da-5258-4c22-b620-ad6923a74762: creating. {{(pid=87278) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:44 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca 1073741824" returned: 0 in 0.718s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:44 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca Sep 08 07:26:44 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-d45c69e3-c633-4e86-81ea-5ff4390d924d-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:44 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca" returned: 0 in 0.337s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Lock "cinder-d45c69e3-c633-4e86-81ea-5ff4390d924d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.577s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1922f599-a416-4763-98f1-0a12773cb857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45720d0-7127-4675-b56a-909073e9c2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:44 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:44 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:44 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Volume volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca (08e38f10-3b2e-44ce-8aaa-5eef96dca0ca): created successfully Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45720d0-7127-4675-b56a-909073e9c2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Flow 'volume_create_manager' (3c3b9789-33ce-4ec2-87ca-3cdbe44be1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Creating offline snapshot 207f9cbf-d513-49cc-9448-4adc118729cd of volume 1a2639fd-d3de-4149-a38d-a93fbf342b0e {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:26:44 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-231cbde2-fa84-4753-a65e-8ec13f28f9b7 tempest-AttachVolumeTestJSON-1462399904 None] Created volume successfully. Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[368801b2-04b2-4bf3-b6ea-9fae2f89a88e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-quobyte-d45c69e3-c633-4e86-81ea-5ff4390d924d" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-d45c69e3-c633-4e86-81ea-5ff4390d924d" acquired by "delete_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4bf8d0-fb3c-42a6-b4e1-6630f60ade1f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:45 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.333s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:26:45 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e Sep 08 07:26:45 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:45 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d Sep 08 07:26:45 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:45 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e" returned: 0 in 0.531s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:45 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd 1G Sep 08 07:26:45 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:45 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d" returned: 0 in 0.500s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:45 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d Sep 08 07:26:45 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:45 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d45c69e3-c633-4e86-81ea-5ff4390d924d" returned: 0 in 0.346s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-d45c69e3-c633-4e86-81ea-5ff4390d924d" released by "delete_volume" :: held 0.912s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:45 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Created reservations ['f0f67486-96f1-49e3-907a-54e9a2ba35ea', '8fa9e398-2a78-4bda-8c81-241f32a3424b', 'f1de26e6-2165-4964-a6e3-d12c25d88d25', '90f1baef-ab62-4c91-873e-528662c3ec96'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:46 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd 1G" returned: 0 in 0.642s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:46 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd Sep 08 07:26:46 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:46 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:46 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-6fc9d78e-d78b-4bd6-94a2-1bb7e7c38042 req-bb6f0448-cf27-4e6c-9d94-865668c2fc8b tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:46 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.326s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:46 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Deleted volume successfully. Sep 08 07:26:46 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd" returned: 0 in 0.369s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:46 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d3046991-cf72-4328-bc61-676d8fc5674a tempest-VolumesGetTest-106567064 None] Lock "cinder-d45c69e3-c633-4e86-81ea-5ff4390d924d-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:46 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd Sep 08 07:26:46 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:46 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd" returned: 0 in 0.256s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:46 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.info Sep 08 07:26:46 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-8ce81596-4038-4105-b289-3d4d715a7dfe-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Lock "cinder-8ce81596-4038-4105-b289-3d4d715a7dfe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:47 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.info" returned: 0 in 0.321s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:47 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-quobyte-8ce81596-4038-4105-b289-3d4d715a7dfe" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:47 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.info Sep 08 07:26:47 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-8ce81596-4038-4105-b289-3d4d715a7dfe" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98a1350-4bae-45b2-b1e4-43b69e1e66ad]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:47 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe Sep 08 07:26:47 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:47 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.info" returned: 0 in 0.294s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-6fc9d78e-d78b-4bd6-94a2-1bb7e7c38042 req-bb6f0448-cf27-4e6c-9d94-865668c2fc8b tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.056s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-6fc9d78e-d78b-4bd6-94a2-1bb7e7c38042 req-bb6f0448-cf27-4e6c-9d94-865668c2fc8b tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-6fc9d78e-d78b-4bd6-94a2-1bb7e7c38042 req-bb6f0448-cf27-4e6c-9d94-865668c2fc8b tempest-AttachVolumeTestJSON-1462399904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1ba48cc-fffb-4ab3-b844-7af6051372f3', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:26:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fdbfc656-d740-4538-b91b-76e6639b3bb4 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 19be79da-5258-4c22-b620-ad6923a74762: created successfully Sep 08 07:26:47 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe" returned: 0 in 0.412s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-6fc9d78e-d78b-4bd6-94a2-1bb7e7c38042 req-bb6f0448-cf27-4e6c-9d94-865668c2fc8b tempest-AttachVolumeTestJSON-1462399904 None] attachment_update completed successfully. Sep 08 07:26:47 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe Sep 08 07:26:47 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:47 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ce81596-4038-4105-b289-3d4d715a7dfe" returned: 0 in 0.291s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-8ce81596-4038-4105-b289-3d4d715a7dfe" released by "delete_volume" :: held 0.760s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:47 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Created reservations ['69a4f6ae-4e37-420e-a600-a8ad0d52bc1b', 'dd670b0e-272c-4601-b6cc-e9c02933ef27', '8da25f48-08af-488c-ab58-b0a2d42a1d74', '01f06068-9b78-408f-a3e6-3ca346bdd902'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:48 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:48 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:48 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-0f453eea-1c7d-478b-a7c5-11188f6bbae5-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.482s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:48 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Deleted volume successfully. Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Lock "cinder-0f453eea-1c7d-478b-a7c5-11188f6bbae5-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e653b331-4491-45e7-8c75-5025c9d1ac75 tempest-VolumesGetTest-106567064 None] Lock "cinder-8ce81596-4038-4105-b289-3d4d715a7dfe-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-quobyte-0f453eea-1c7d-478b-a7c5-11188f6bbae5" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-0f453eea-1c7d-478b-a7c5-11188f6bbae5" acquired by "delete_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:48 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 19be79da-5258-4c22-b620-ad6923a74762: deleting Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 19be79da-5258-4c22-b620-ad6923a74762: deleting {{(pid=87278) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b86073c-7393-40c0-a05f-ee6ac7b8e30c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-1a2639fd-d3de-4149-a38d-a93fbf342b0e" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-1a2639fd-d3de-4149-a38d-a93fbf342b0e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-207f9cbf-d513-49cc-9448-4adc118729cd" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-207f9cbf-d513-49cc-9448-4adc118729cd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Deleting offline snapshot 207f9cbf-d513-49cc-9448-4adc118729cd of volume 1a2639fd-d3de-4149-a38d-a93fbf342b0e {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] snapshot_file for this snap is: volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ea8c34-1ba2-4dca-8262-3027b3b77f00]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:48 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 Sep 08 07:26:48 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:49 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd Sep 08 07:26:49 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:49 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5" returned: 0 in 0.561s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:49 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5 Sep 08 07:26:49 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:49 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd" returned: 0 in 0.496s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9725252-f5f0-4151-9fbb-dc20ba629f63]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:49 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-c5be9e48-31d6-428c-b27a-e0b81d375021 req-fa2f9ae8-1593-425e-8367-27d0ddb22b3d tempest-AttachVolumeTestJSON-1462399904 None] Terminate volume connection completed successfully. Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-c5be9e48-31d6-428c-b27a-e0b81d375021 req-fa2f9ae8-1593-425e-8367-27d0ddb22b3d tempest-AttachVolumeTestJSON-1462399904 None] Deleting attachment 9500cdc4-0504-44c0-9f77-465240f770c9. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:26:49 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e Sep 08 07:26:49 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:49 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0f453eea-1c7d-478b-a7c5-11188f6bbae5" returned: 0 in 0.346s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-0f453eea-1c7d-478b-a7c5-11188f6bbae5" released by "delete_volume" :: held 1.065s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Created reservations ['0a93695d-4997-4237-b5c6-fa475ce30166', '4257c056-f34c-4502-a56f-ba0da1f4ef00', '69c7779b-70ad-40e2-b7c5-41bbdf27f9fa', '9d6ef532-46d6-4da6-9c95-1522abe80d55'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:49 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:49 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:50 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e" returned: 0 in 0.528s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:50 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd Sep 08 07:26:50 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:50 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.295s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:50 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Deleted volume successfully. Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04b6bf1-e6bf-4a01-8bf4-89e8c3bebe6e tempest-VolumesGetTest-106567064 None] Lock "cinder-0f453eea-1c7d-478b-a7c5-11188f6bbae5-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:50 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd" returned: 0 in 0.465s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:50 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd Sep 08 07:26:50 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:50 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e.207f9cbf-d513-49cc-9448-4adc118729cd" returned: 0 in 0.323s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-207f9cbf-d513-49cc-9448-4adc118729cd" released by "_delete_snapshot" :: held 1.947s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-1a2639fd-d3de-4149-a38d-a93fbf342b0e" released by "delete_snapshot" :: held 1.986s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:50 devstack cinder-volume[87278]: WARNING cinder.quota [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-175398746 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-175398746, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:50 devstack cinder-volume[87278]: WARNING cinder.quota [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-175398746 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-175398746, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:50 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['afd9f8d0-adce-4bbd-bee0-284fd633ee62', '9ba1cec8-4ffd-4e8e-b0b5-07e666aa1dac', '63d34d39-ba09-4b9c-b1f9-a6e37e9e34f4', '179b08c5-e452-4855-a754-e97fa0d6765e'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:51 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-452a146d-3061-4498-a733-51fb346c7479 tempest-GroupSnapshotsTest-1689214778 None] group_snapshot 19be79da-5258-4c22-b620-ad6923a74762: deleted successfully Sep 08 07:26:51 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-983f491f-f2fc-4282-a507-33e5c8a807c0 req-b11c4569-e461-4b2d-bfd2-5eea4e424c92 tempest-AttachVolumeTestJSON-1462399904 None] Terminate volume connection completed successfully. Sep 08 07:26:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-983f491f-f2fc-4282-a507-33e5c8a807c0 req-b11c4569-e461-4b2d-bfd2-5eea4e424c92 tempest-AttachVolumeTestJSON-1462399904 None] Deleting attachment b1ba48cc-fffb-4ab3-b844-7af6051372f3. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:26:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "cinder-quobyte-1a2639fd-d3de-4149-a38d-a93fbf342b0e" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-1a2639fd-d3de-4149-a38d-a93fbf342b0e" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:51 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab41ebd-0e88-40a7-aeb6-9b0d3c236660]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:51 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e Sep 08 07:26:51 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:52 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e" returned: 0 in 0.462s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:52 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e Sep 08 07:26:52 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (80bd2d3b-84a3-4ae1-a429-e70496a81ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224741c4-cae5-4eb6-9e10-5b62a71aef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224741c4-cae5-4eb6-9e10-5b62a71aef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1730304577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000c9fd2-b819-4d30-9df8-6747bcd4eaf2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:52Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e78f702-1b66-4472-879d-770c82bffdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e78f702-1b66-4472-879d-770c82bffdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57047a9-d27d-49bc-984c-9697176fa555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:26:52 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a2639fd-d3de-4149-a38d-a93fbf342b0e" returned: 0 in 0.348s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Lock "cinder-quobyte-1a2639fd-d3de-4149-a38d-a93fbf342b0e" released by "delete_volume" :: held 0.902s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['406da9db-0afe-41be-866d-a218ecd3a68d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:52 devstack cinder-volume[87278]: WARNING cinder.quota [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-175398746 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-175398746, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Created reservations ['12d64d2f-7fbd-46cd-84a5-b0c370a774ec', '409a0203-efb9-4753-9dc4-dc5bccc57a89', '9c0ace6a-2cc5-449d-b6f1-47a84539cf55', '74c72a0b-a2b3-4ff9-a465-b50a9b0f7512'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:53 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:53 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57047a9-d27d-49bc-984c-9697176fa555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '000c9fd2-b819-4d30-9df8-6747bcd4eaf2', 'volume_name': 'volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facbe1bc-03ba-4cff-b0f2-768ba962128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facbe1bc-03ba-4cff-b0f2-768ba962128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521599f5-eafd-484c-a93b-9f3b5b7e9b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:53 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Volume 000c9fd2-b819-4d30-9df8-6747bcd4eaf2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Trying to clone 000c9fd2-b819-4d30-9df8-6747bcd4eaf2 from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:26:53 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.774s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:53 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6ea50936-7687-4d31-92cb-6a24b616a8f9 tempest-GroupSnapshotsTest-1689214778 None] Delete group completed successfully. Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:26:53 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Image download 20.69 MB at 20.69 MB/s Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2fd149-8ee0-40cc-b02a-32a9fecca897]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:54 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD Sep 08 07:26:54 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:54 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 is fetched for user e05b53bddae6488eacee4148eb79d554. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c772631-d462-4da9-8fb0-0c0730cef7a3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:54 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD Sep 08 07:26:54 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:54 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1730304577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000c9fd2-b819-4d30-9df8-6747bcd4eaf2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:26:52Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Creating volume 000c9fd2-b819-4d30-9df8-6747bcd4eaf2 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:26:54 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:26:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:54 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 1073741824 Sep 08 07:26:54 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:55 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 1073741824" returned: 0 in 0.549s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:55 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 Sep 08 07:26:55 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:55 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2" returned: 0 in 0.286s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:26:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:55 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Attempting download of cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume 000c9fd2-b819-4d30-9df8-6747bcd4eaf2. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:26:55 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a34b0c-336a-4b3d-9a7a-d973d03bebed]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_yf7mty21 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:56 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_yf7mty21 Sep 08 07:26:56 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:56 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_yf7mty21" returned: 0 in 0.394s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_yf7mty21 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:56 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_yf7mty21 Sep 08 07:26:56 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:56 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_yf7mty21" returned: 1 in 0.414s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_yf7mty21' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[730f875f-1ded-4e76-9793-cc53ff593574]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:56 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD Sep 08 07:26:56 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "cinder-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "cinder-quobyte-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-quobyte-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[877be1ad-808f-43d2-affd-497277bef5c5]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:57 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 was qcow2, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:57 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 Sep 08 07:26:57 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca Sep 08 07:26:57 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:57 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:57 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca" returned: 0 in 0.416s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:57 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca Sep 08 07:26:57 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:57 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca" returned: 0 in 0.292s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-quobyte-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca" released by "delete_volume" :: held 0.770s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Created reservations ['679d6e48-907b-4b3e-b9e0-4ea799fabef2', 'd163a71a-a697-4fdf-b2d0-4942cbd88592', '6a41f114-087c-4c6a-b8e6-758d92e4d0cd', '166fc0be-1440-499f-9bf5-060477f13236'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:57 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:57 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "cinder-e355aca0-c3df-4a1f-9043-e84e9c215ebf-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-e355aca0-c3df-4a1f-9043-e84e9c215ebf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:58 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.332s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:58 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Deleted volume successfully. Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "cinder-quobyte-e355aca0-c3df-4a1f-9043-e84e9c215ebf" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-quobyte-e355aca0-c3df-4a1f-9043-e84e9c215ebf" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a3c55d39-9753-4691-82aa-e7e47b57abf7 tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-08e38f10-3b2e-44ce-8aaa-5eef96dca0ca-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d545426-4efd-4fba-8667-f42c53e70d87]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:58 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf Sep 08 07:26:58 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:58 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf" returned: 0 in 0.432s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:58 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf Sep 08 07:26:58 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:59 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e355aca0-c3df-4a1f-9043-e84e9c215ebf" returned: 0 in 0.299s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-quobyte-e355aca0-c3df-4a1f-9043-e84e9c215ebf" released by "delete_volume" :: held 0.784s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Created reservations ['555abfce-d10f-4fc9-b8a2-9006733ea77e', '768635d1-5297-4e2b-b180-ae7519590739', '08456147-05d6-4064-aba5-6996b39f0c54', 'd3a25b66-8e5a-48c4-bd9d-6a010c4cbd50'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:26:59 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2" returned: 0 in 2.038s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_l5t4nqicdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:26:59 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Converted 112.00 MB image at 54.93 MB/s Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:59 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 1G Sep 08 07:26:59 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:59 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:26:59 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "cinder-2fa57dc8-038a-4271-a5f3-11ef92111e01-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-2fa57dc8-038a-4271-a5f3-11ef92111e01-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:59 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.374s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:26:59 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 08 07:26:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Deleted volume successfully. Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 1G" returned: 0 in 0.460s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Downloaded image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume 000c9fd2-b819-4d30-9df8-6747bcd4eaf2 successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 for user e05b53bddae6488eacee4148eb79d554 is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Marking volume 000c9fd2-b819-4d30-9df8-6747bcd4eaf2 as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "cinder-quobyte-2fa57dc8-038a-4271-a5f3-11ef92111e01" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Copying metadata from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 to 000c9fd2-b819-4d30-9df8-6747bcd4eaf2. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Creating volume glance metadata for volume 000c9fd2-b819-4d30-9df8-6747bcd4eaf2 backed by image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-105bb61a-e60c-4716-816b-1799bcd28b05 tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-e355aca0-c3df-4a1f-9043-e84e9c215ebf-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-quobyte-2fa57dc8-038a-4271-a5f3-11ef92111e01" acquired by "delete_volume" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceb0800-a2f1-4c4c-b9c9-f079d7a89f17]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521599f5-eafd-484c-a93b-9f3b5b7e9b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2298661d-b0e3-4549-87fd-03e2936e4eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:26:59 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Volume volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 (000c9fd2-b819-4d30-9df8-6747bcd4eaf2): created successfully Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2298661d-b0e3-4549-87fd-03e2936e4eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:26:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (80bd2d3b-84a3-4ae1-a429-e70496a81ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:26:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e770a113-6a41-4cae-9c2f-3a23a7910dd4 tempest-VolumesGetTest-106567064 None] Created volume successfully. Sep 08 07:26:59 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 Sep 08 07:26:59 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:00 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01" returned: 0 in 0.417s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:00 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01 Sep 08 07:27:00 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:00 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2fa57dc8-038a-4271-a5f3-11ef92111e01" returned: 0 in 0.267s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-quobyte-2fa57dc8-038a-4271-a5f3-11ef92111e01" released by "delete_volume" :: held 0.732s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Created reservations ['b2dac3d7-a0b8-44e2-b3aa-3fd8958f5656', '50febef9-b477-4753-835e-550fcf52a438', '210848b4-11e7-4262-877c-8246db94721c', '2c2196f1-aa48-4a3d-bf74-ac370c824e0c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:00 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:00 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (39d75dfc-33df-458b-887f-d1b679ad7282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f1ee10-de74-4a62-97e8-aa7e67c00eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f1ee10-de74-4a62-97e8-aa7e67c00eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1296936960',display_name='tempest-VolumesGetTest-Volume-1656889377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d173fd8-dd43-48d3-a914-874b55ae9bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:01Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f99311-d4d3-4a4c-832f-412a7a81536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f99311-d4d3-4a4c-832f-412a7a81536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79541f19-f416-42f6-af2a-3349a2c2746a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79541f19-f416-42f6-af2a-3349a2c2746a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d173fd8-dd43-48d3-a914-874b55ae9bbd', 'volume_name': 'volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753e3a05-1e7b-4f60-b634-786049b94431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753e3a05-1e7b-4f60-b634-786049b94431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ebc01c-301c-49c7-8d09-1f2238ff146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:00 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Volume 4d173fd8-dd43-48d3-a914-874b55ae9bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd', 'volume_size': 1} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1296936960',display_name='tempest-VolumesGetTest-Volume-1656889377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d173fd8-dd43-48d3-a914-874b55ae9bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eba7fad39a4dac8d773613a401a88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:01Z,use_quota=True,user_id='e05b53bddae6488eacee4148eb79d554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Creating volume 4d173fd8-dd43-48d3-a914-874b55ae9bbd {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:00 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:00 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd 1073741824 Sep 08 07:27:00 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:00 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.320s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:00 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Deleted volume successfully. Sep 08 07:27:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ccce65f1-d87d-4207-adc1-8ac0facb3bfb tempest-AttachVolumeTestJSON-1462399904 None] Lock "cinder-2fa57dc8-038a-4271-a5f3-11ef92111e01-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:01 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd 1073741824" returned: 0 in 0.521s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:01 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd Sep 08 07:27:01 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:01 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd" returned: 0 in 0.375s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ebc01c-301c-49c7-8d09-1f2238ff146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e126d3cc-9916-4e7a-827a-9888a5ff13b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:01 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Volume volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd (4d173fd8-dd43-48d3-a914-874b55ae9bbd): created successfully Sep 08 07:27:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e126d3cc-9916-4e7a-827a-9888a5ff13b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Flow 'volume_create_manager' (39d75dfc-33df-458b-887f-d1b679ad7282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fa9e9ca2-f595-4078-b123-548d5da77f06 tempest-VolumesGetTest-106567064 None] Created volume successfully. Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-4d173fd8-dd43-48d3-a914-874b55ae9bbd-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Lock "cinder-4d173fd8-dd43-48d3-a914-874b55ae9bbd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=230,cinder:SELECT=212,cinder:INSERT=54,cinder:DELETE=6 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=202,cinder:INSERT=60,cinder:UPDATE=209,cinder:DELETE=18 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-quobyte-4d173fd8-dd43-48d3-a914-874b55ae9bbd" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-4d173fd8-dd43-48d3-a914-874b55ae9bbd" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9f67b4-13ad-40e6-a514-b0f47c2fa09e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:03 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd Sep 08 07:27:03 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:03 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd" returned: 0 in 0.521s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:03 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd Sep 08 07:27:03 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:04 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d173fd8-dd43-48d3-a914-874b55ae9bbd" returned: 0 in 0.416s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-4d173fd8-dd43-48d3-a914-874b55ae9bbd" released by "delete_volume" :: held 1.007s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Created reservations ['bed7b322-3fd9-45db-afca-9b5d46692009', '1401fd4d-b339-49fb-a9a6-519770de3910', 'af3dfe01-72de-4208-8bce-29732ff34750', 'd95c120f-055b-4692-a69e-6b93758eeb70'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:04 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:04 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Flow 'volume_create_manager' (f41a2959-4f71-4a66-832b-8026ef9fd357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ddec38-567f-495e-b75b-8366558cfe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ddec38-567f-495e-b75b-8366558cfe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-706270960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704bfbcb-d001-4be0-8798-614be276e6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b0a11622b04caab7741b8ae218e5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:04Z,use_quota=True,user_id='d35fc2a8bd604ce8895014e8f9319eb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facd5950-7aed-4b6b-a63c-95a97b569c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facd5950-7aed-4b6b-a63c-95a97b569c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf40d215-390d-4b44-9d3b-cfca7a1220a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf40d215-390d-4b44-9d3b-cfca7a1220a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '704bfbcb-d001-4be0-8798-614be276e6bf', 'volume_name': 'volume-704bfbcb-d001-4be0-8798-614be276e6bf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d89def-bff4-4128-9c8d-dd0fbb6247b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d89def-bff4-4128-9c8d-dd0fbb6247b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f58720a-155b-4c1b-9ba3-317fd77909e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:04 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Volume 704bfbcb-d001-4be0-8798-614be276e6bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-704bfbcb-d001-4be0-8798-614be276e6bf', 'volume_size': 1} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-706270960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704bfbcb-d001-4be0-8798-614be276e6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b0a11622b04caab7741b8ae218e5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:04Z,use_quota=True,user_id='d35fc2a8bd604ce8895014e8f9319eb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Creating volume 704bfbcb-d001-4be0-8798-614be276e6bf {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:04 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:04 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf 1073741824 Sep 08 07:27:04 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:04 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.310s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Deleted volume successfully. Sep 08 07:27:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3c3ddea-1aea-44d5-8b1b-2498c8c0564f tempest-VolumesGetTest-106567064 None] Lock "cinder-4d173fd8-dd43-48d3-a914-874b55ae9bbd-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:05 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf 1073741824" returned: 0 in 0.583s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:05 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf Sep 08 07:27:05 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-000c9fd2-b819-4d30-9df8-6747bcd4eaf2-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Lock "cinder-000c9fd2-b819-4d30-9df8-6747bcd4eaf2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Acquiring lock "cinder-quobyte-000c9fd2-b819-4d30-9df8-6747bcd4eaf2" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-000c9fd2-b819-4d30-9df8-6747bcd4eaf2" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22541b1-b4e6-4ed6-9e2e-8b1c684a8e20]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:05 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf" returned: 0 in 0.457s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f58720a-155b-4c1b-9ba3-317fd77909e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704bfbcb-d001-4be0-8798-614be276e6bf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b2368e-b70f-423d-8633-5331e6f71d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:05 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Volume volume-704bfbcb-d001-4be0-8798-614be276e6bf (704bfbcb-d001-4be0-8798-614be276e6bf): created successfully Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b2368e-b70f-423d-8633-5331e6f71d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Flow 'volume_create_manager' (f41a2959-4f71-4a66-832b-8026ef9fd357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:05 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ba3742dd-0614-45d2-8c1e-04293154e83b tempest-AttachVolumeNegativeTest-1601447696 None] Created volume successfully. Sep 08 07:27:05 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 Sep 08 07:27:05 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:06 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2" returned: 0 in 0.500s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:06 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2 Sep 08 07:27:06 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:06 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-000c9fd2-b819-4d30-9df8-6747bcd4eaf2" returned: 0 in 0.323s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Lock "cinder-quobyte-000c9fd2-b819-4d30-9df8-6747bcd4eaf2" released by "delete_volume" :: held 0.891s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Created reservations ['215858fa-5609-4282-96b2-d667aa1457d6', '5776a29b-31cc-41c1-b959-6c1f078f64b2', 'f616f7b5-e396-4acd-baa1-7f301351dbb7', '3fcae94b-5146-49f8-81a1-ab0f7e1d69aa'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:06 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:06 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:07 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.365s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:07 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:07 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Deleted volume successfully. Sep 08 07:27:07 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a676593e-1d9c-46e3-8d6a-534172a001c7 tempest-VolumesGetTest-106567064 None] Lock "cinder-000c9fd2-b819-4d30-9df8-6747bcd4eaf2-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-4f2e5342-12d4-4716-809f-4cbda5b06461 req-ae43790d-35f9-4974-b8c0-6c6a71617536 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-4f2e5342-12d4-4716-809f-4cbda5b06461 req-ae43790d-35f9-4974-b8c0-6c6a71617536 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-4f2e5342-12d4-4716-809f-4cbda5b06461 req-ae43790d-35f9-4974-b8c0-6c6a71617536 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-4f2e5342-12d4-4716-809f-4cbda5b06461 req-ae43790d-35f9-4974-b8c0-6c6a71617536 tempest-AttachVolumeNegativeTest-1601447696 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-704bfbcb-d001-4be0-8798-614be276e6bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61e0d90d-dc96-45e0-9d03-63487898811c', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:27:07 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-4f2e5342-12d4-4716-809f-4cbda5b06461 req-ae43790d-35f9-4974-b8c0-6c6a71617536 tempest-AttachVolumeNegativeTest-1601447696 None] attachment_update completed successfully. Sep 08 07:27:10 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-37cccf1a-ae81-4a7a-b3fe-4d3a63815780 tempest-GroupsTest-1924038583 None] Group tempest-Group1-1255973723: creating Sep 08 07:27:10 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-37cccf1a-ae81-4a7a-b3fe-4d3a63815780 tempest-GroupsTest-1924038583 None] Group tempest-Group1-1255973723: created successfully Sep 08 07:27:10 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-37cccf1a-ae81-4a7a-b3fe-4d3a63815780 tempest-GroupsTest-1924038583 None] Create group completed successfully. Sep 08 07:27:10 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-1cdb5fb3-ba0c-46c1-9482-bce44e49af18 req-631a5c56-54aa-44bd-9b55-50550d446c3b tempest-AttachVolumeNegativeTest-1601447696 None] Terminate volume connection completed successfully. Sep 08 07:27:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-1cdb5fb3-ba0c-46c1-9482-bce44e49af18 req-631a5c56-54aa-44bd-9b55-50550d446c3b tempest-AttachVolumeNegativeTest-1601447696 None] Deleting attachment 61e0d90d-dc96-45e0-9d03-63487898811c. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Flow 'volume_create_manager' (a64840d4-8c3e-48e6-abd7-f540d21f3129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c52fbe4-8107-498b-9504-fca8fd7bd158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c52fbe4-8107-498b-9504-fca8fd7bd158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1657866549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6040092-4668-439e-9678-ba337f09757e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790ff125ef9e45faa8adadecaaec8bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:11Z,use_quota=True,user_id='4ea42f68b90546b99a3ad3c2546ae04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c1ae95-4cb1-49a0-8c1e-7a65b465bbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c1ae95-4cb1-49a0-8c1e-7a65b465bbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ef9cdb-2ed1-49df-94d5-fa73ff20adcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ef9cdb-2ed1-49df-94d5-fa73ff20adcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6040092-4668-439e-9678-ba337f09757e', 'volume_name': 'volume-b6040092-4668-439e-9678-ba337f09757e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d298fa1d-4948-4de0-b56d-2e608149b6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d298fa1d-4948-4de0-b56d-2e608149b6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04cc28f-5ae9-4e6a-998c-a95e820194c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:11 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Volume b6040092-4668-439e-9678-ba337f09757e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6040092-4668-439e-9678-ba337f09757e', 'volume_size': 1} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1657866549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6040092-4668-439e-9678-ba337f09757e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790ff125ef9e45faa8adadecaaec8bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:11Z,use_quota=True,user_id='4ea42f68b90546b99a3ad3c2546ae04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Creating volume b6040092-4668-439e-9678-ba337f09757e {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:11 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:11 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e 1073741824 Sep 08 07:27:11 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:11 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b315a103-385e-402c-8e1f-42493917378e tempest-GroupsTest-1924038583 None] Group tempest-Group2-794058268: creating Sep 08 07:27:11 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b315a103-385e-402c-8e1f-42493917378e tempest-GroupsTest-1924038583 None] Group tempest-Group2-794058268: created successfully Sep 08 07:27:11 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b315a103-385e-402c-8e1f-42493917378e tempest-GroupsTest-1924038583 None] Create group completed successfully. Sep 08 07:27:12 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e 1073741824" returned: 0 in 0.823s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:12 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e Sep 08 07:27:12 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Flow 'volume_create_manager' (9e472038-ef77-4cb6-8158-14848d4a8ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc20a3c5-433c-474b-b625-27263d1f9036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc20a3c5-433c-474b-b625-27263d1f9036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-34782972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236726a5-8544-40e3-93a0-3120a8700402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd2850199ec44d4b0277e4c7a337712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:12Z,use_quota=True,user_id='d6ce7dc4e1ac4d749bb28922bc947fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c6fe17-66b9-44eb-a380-9d01a90ba1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c6fe17-66b9-44eb-a380-9d01a90ba1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280083c6-c388-443d-ba34-c84268568ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280083c6-c388-443d-ba34-c84268568ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '236726a5-8544-40e3-93a0-3120a8700402', 'volume_name': 'volume-236726a5-8544-40e3-93a0-3120a8700402', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6764bec5-71eb-431b-bfd0-3389d94caf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6764bec5-71eb-431b-bfd0-3389d94caf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423929de-8237-4dca-a272-21e41d522469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:12 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Volume 236726a5-8544-40e3-93a0-3120a8700402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-236726a5-8544-40e3-93a0-3120a8700402', 'volume_size': 1} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:12 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e" returned: 0 in 0.361s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-34782972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236726a5-8544-40e3-93a0-3120a8700402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd2850199ec44d4b0277e4c7a337712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:12Z,use_quota=True,user_id='d6ce7dc4e1ac4d749bb28922bc947fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Creating volume 236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:12 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:12 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 1073741824 Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04cc28f-5ae9-4e6a-998c-a95e820194c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6040092-4668-439e-9678-ba337f09757e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:12 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56fad0e-894f-4c5a-b26e-41e4638049fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:12 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Volume volume-b6040092-4668-439e-9678-ba337f09757e (b6040092-4668-439e-9678-ba337f09757e): created successfully Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56fad0e-894f-4c5a-b26e-41e4638049fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Flow 'volume_create_manager' (a64840d4-8c3e-48e6-abd7-f540d21f3129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:12 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-26faa5bc-1f3c-4df1-80bc-b7ddb35567a4 req-f4b4a0d1-a1b7-404f-945a-69f57a70f3c4 tempest-VolumesSnapshotsTestJSON-1597135007 None] Created volume successfully. Sep 08 07:27:13 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 1073741824" returned: 0 in 0.595s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:13 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 Sep 08 07:27:13 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Flow 'volume_create_manager' (b8df71f3-dbfc-49ed-9cf8-3dbe6c8e4b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d401b687-d134-4662-8b02-d3ce18eef3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d401b687-d134-4662-8b02-d3ce18eef3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1963351028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cee29002-5a90-4cca-a453-c85236ffe8f0,host='devstack@QuobyteHD#QuobyteHD',id=3b767052-d46a-48f4-93f1-289c5626d1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e957cbcd44ff46caae555cc4c932a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:13Z,use_quota=True,user_id='6e85c81fea904eb893458cde6921ffc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(603b1ee2-f38e-411c-b949-0a442e76c53c),volume_type_id=603b1ee2-f38e-411c-b949-0a442e76c53c)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e2ecae-2952-4113-a6c5-b3544181f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e2ecae-2952-4113-a6c5-b3544181f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21db88c3-8920-4dc9-bfac-4814f8837a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21db88c3-8920-4dc9-bfac-4814f8837a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b767052-d46a-48f4-93f1-289c5626d1fb', 'volume_name': 'volume-3b767052-d46a-48f4-93f1-289c5626d1fb', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad432b2-44d3-4d16-8093-6e71d43715d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:13 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad432b2-44d3-4d16-8093-6e71d43715d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb2f855-1501-4323-be09-fbbe01063411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:13 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Volume 3b767052-d46a-48f4-93f1-289c5626d1fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b767052-d46a-48f4-93f1-289c5626d1fb', 'volume_size': 1} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402" returned: 0 in 0.453s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cee29002-5a90-4cca-a453-c85236ffe8f0,created_at=2026-09-08T05:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1963351028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cee29002-5a90-4cca-a453-c85236ffe8f0,host='devstack@QuobyteHD#QuobyteHD',id=3b767052-d46a-48f4-93f1-289c5626d1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e957cbcd44ff46caae555cc4c932a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:13Z,use_quota=True,user_id='6e85c81fea904eb893458cde6921ffc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(603b1ee2-f38e-411c-b949-0a442e76c53c),volume_type_id=603b1ee2-f38e-411c-b949-0a442e76c53c)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Creating volume 3b767052-d46a-48f4-93f1-289c5626d1fb {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:13 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423929de-8237-4dca-a272-21e41d522469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-236726a5-8544-40e3-93a0-3120a8700402', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:13 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb 1073741824 Sep 08 07:27:13 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9308bd2-b735-449c-a4cf-9138a4e8e21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:13 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Volume volume-236726a5-8544-40e3-93a0-3120a8700402 (236726a5-8544-40e3-93a0-3120a8700402): created successfully Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9308bd2-b735-449c-a4cf-9138a4e8e21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Flow 'volume_create_manager' (9e472038-ef77-4cb6-8158-14848d4a8ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:13 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-885244a7-a98b-4b7a-9557-65203982b71f tempest-VolumesSnapshotListTestJSON-1794804704 None] Created volume successfully. Sep 08 07:27:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:14 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb 1073741824" returned: 0 in 0.590s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:14 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb Sep 08 07:27:14 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:14 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb" returned: 0 in 0.276s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.729s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Creating offline snapshot 84635bef-c75f-4e67-b940-41122eb815db of volume b6040092-4668-439e-9678-ba337f09757e {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb2f855-1501-4323-be09-fbbe01063411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b767052-d46a-48f4-93f1-289c5626d1fb', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4357c3-da13-46c9-9e99-4e3c7cf0ffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a5d2c1-9481-4f6e-a193-dabae118a6c5]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Volume volume-3b767052-d46a-48f4-93f1-289c5626d1fb (3b767052-d46a-48f4-93f1-289c5626d1fb): created successfully Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4357c3-da13-46c9-9e99-4e3c7cf0ffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Flow 'volume_create_manager' (b8df71f3-dbfc-49ed-9cf8-3dbe6c8e4b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-eb6da878-54a7-466b-8b55-178027c202a5 tempest-GroupsTest-1924038583 None] Created volume successfully. Sep 08 07:27:14 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e Sep 08 07:27:14 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:15 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e" returned: 0 in 0.438s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:15 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db 1G Sep 08 07:27:15 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:15 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db 1G" returned: 0 in 0.443s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6040092-4668-439e-9678-ba337f09757e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:15 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6040092-4668-439e-9678-ba337f09757e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db Sep 08 07:27:15 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "cinder-704bfbcb-d001-4be0-8798-614be276e6bf-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-704bfbcb-d001-4be0-8798-614be276e6bf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "cinder-quobyte-704bfbcb-d001-4be0-8798-614be276e6bf" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-quobyte-704bfbcb-d001-4be0-8798-614be276e6bf" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b197efe7-4ef4-442a-8d27-8d3def5a6b2e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:15 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6040092-4668-439e-9678-ba337f09757e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db" returned: 0 in 0.406s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:15 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db is being set with open permissions: ugo+rw Sep 08 07:27:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:15 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db Sep 08 07:27:15 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:15 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf Sep 08 07:27:15 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:16 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db" returned: 0 in 0.262s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:16 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:16 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.info Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf" returned: 0 in 0.399s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:16 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:16 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf Sep 08 07:27:16 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Acquiring lock "cinder-quobyte-3b767052-d46a-48f4-93f1-289c5626d1fb" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Lock "cinder-quobyte-3b767052-d46a-48f4-93f1-289c5626d1fb" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:16 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.info" returned: 0 in 0.303s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:16 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.info is being set with open permissions: ugo+rw Sep 08 07:27:16 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-704bfbcb-d001-4be0-8798-614be276e6bf" returned: 0 in 0.290s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[448321c9-2a85-4912-81f8-5df22a3067ea]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:16 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.info Sep 08 07:27:16 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-quobyte-704bfbcb-d001-4be0-8798-614be276e6bf" released by "delete_volume" :: held 0.744s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Created reservations ['b03cc06f-b72b-40e6-8f05-f0a0cce413da', '52e36d27-a039-4f19-94a3-3decfb6d9e08', '5a8e35a0-6d40-4a93-a38a-23484aece851', '64a0738e-482a-4c48-9ef9-c47c378564b0'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:16 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb Sep 08 07:27:16 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:16 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:16 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:16 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.info" returned: 0 in 0.290s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.975s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Creating offline snapshot 74a39e69-5b82-4b05-af66-e382ea1f298c of volume 236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a6a106-9f80-4d4a-bdf4-80e2666d7ecf]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:16 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-e7ca01b9-4447-46d6-8051-1d23461bf4b8 req-3d4f2531-ec8c-4a2b-8ab7-34cfb7247541 tempest-VolumesSnapshotsTestJSON-1597135007 None] Create snapshot completed successfully Sep 08 07:27:16 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:16 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb" returned: 0 in 0.449s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.320s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:16 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Deleted volume successfully. Sep 08 07:27:17 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb Sep 08 07:27:17 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2254342e-9aa2-4127-8a94-9023249d59f3 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-704bfbcb-d001-4be0-8798-614be276e6bf-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:17 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 Sep 08 07:27:17 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "cinder-3e6499b6-b52f-4e23-a735-97643e662efe-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-3e6499b6-b52f-4e23-a735-97643e662efe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "cinder-quobyte-3e6499b6-b52f-4e23-a735-97643e662efe" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-quobyte-3e6499b6-b52f-4e23-a735-97643e662efe" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[798baaba-f786-4515-bab0-728770836427]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:17 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3b767052-d46a-48f4-93f1-289c5626d1fb" returned: 0 in 0.306s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:17 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe Sep 08 07:27:17 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Lock "cinder-quobyte-3b767052-d46a-48f4-93f1-289c5626d1fb" released by "delete_volume" :: held 0.823s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:17 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402" returned: 0 in 0.432s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:17 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c 1G Sep 08 07:27:17 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Created reservations ['52ca4ec9-5379-45ca-babc-07d0c3c6407b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:17 devstack cinder-volume[87278]: WARNING cinder.quota [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-88445892 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-88445892, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:27:17 devstack cinder-volume[87278]: WARNING cinder.quota [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-88445892 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-88445892, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Created reservations ['bf8bfcee-3730-4100-8727-22bb63637cc8', '8b541c18-ca09-4277-a90f-a5992dbb0d86', '78af9f2c-54ab-44d7-9499-e974ea37d596', 'bf57b86a-7013-45a7-b422-08cc44320512'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Acquiring lock "cinder-84635bef-c75f-4e67-b940-41122eb815db-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-84635bef-c75f-4e67-b940-41122eb815db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Acquiring lock "cinder-quobyte-b6040092-4668-439e-9678-ba337f09757e" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-quobyte-b6040092-4668-439e-9678-ba337f09757e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Acquiring lock "cinder-quobyte-84635bef-c75f-4e67-b940-41122eb815db" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-quobyte-84635bef-c75f-4e67-b940-41122eb815db" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Deleting offline snapshot 84635bef-c75f-4e67-b940-41122eb815db of volume b6040092-4668-439e-9678-ba337f09757e {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:27:17 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] snapshot_file for this snap is: volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe" returned: 0 in 0.465s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[39adabb1-904d-4403-89ae-b0db10ce596d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:17 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe Sep 08 07:27:17 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:17 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:17 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:17 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db Sep 08 07:27:17 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:17 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c 1G" returned: 0 in 0.512s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236726a5-8544-40e3-93a0-3120a8700402 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:17 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236726a5-8544-40e3-93a0-3120a8700402 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c Sep 08 07:27:17 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:17 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3e6499b6-b52f-4e23-a735-97643e662efe" returned: 0 in 0.298s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-quobyte-3e6499b6-b52f-4e23-a735-97643e662efe" released by "delete_volume" :: held 0.811s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:17 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.299s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Created reservations ['7b7fbda3-aea6-4434-845d-2453b3da9e07', 'bddfd3e6-dc17-43e5-8f7b-ebe5fb0ee276', '0cf3a102-3d57-4050-bd3c-6ed030ad8ad5', '33ea1ece-bbff-490b-8059-5a895a5418e0'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:18 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a9f7d4a2-fc59-4ee4-8aba-1141361cc309 tempest-GroupsTest-1924038583 None] Delete group completed successfully. Sep 08 07:27:18 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db" returned: 0 in 0.419s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6040092-4668-439e-9678-ba337f09757e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b00d3f-068c-4424-831a-b143d99bdb2f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:18 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:18 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:18 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236726a5-8544-40e3-93a0-3120a8700402 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c" returned: 0 in 0.344s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:18 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c is being set with open permissions: ugo+rw Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:18 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c Sep 08 07:27:18 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:18 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e Sep 08 07:27:18 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:18 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.296s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:18 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Deleted volume successfully. Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6b27565d-4f91-4f78-b904-dcf55affef0d tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-3e6499b6-b52f-4e23-a735-97643e662efe-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "cinder-fe86b170-653c-476e-bc52-4445863fe830-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:18 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c" returned: 0 in 0.289s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-fe86b170-653c-476e-bc52-4445863fe830-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "cinder-quobyte-fe86b170-653c-476e-bc52-4445863fe830" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:18 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.info Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-quobyte-fe86b170-653c-476e-bc52-4445863fe830" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:18 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:18 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e" returned: 0 in 0.462s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f967b-a2b1-4376-a2e6-839da357f866]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:18 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db Sep 08 07:27:18 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:18 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830 Sep 08 07:27:18 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:18 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.info" returned: 0 in 0.304s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:18 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.info is being set with open permissions: ugo+rw Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:18 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.info Sep 08 07:27:18 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] Created reservations ['d92fe231-d1cb-4f88-bc50-4b8ac94f21b6'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:19 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:19 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:19 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db" returned: 0 in 0.441s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:19 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db Sep 08 07:27:19 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:19 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830" returned: 0 in 0.485s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:19 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830 Sep 08 07:27:19 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:19 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.info" returned: 0 in 0.314s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7e011781-29a1-44d1-a046-e7f5ceb26395 tempest-VolumesSnapshotListTestJSON-1794804704 None] Create snapshot completed successfully Sep 08 07:27:19 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.287s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ec38aedc-074e-479f-892b-4d57ae68bfe7 tempest-GroupsTest-1924038583 None] Delete group completed successfully. Sep 08 07:27:19 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e.84635bef-c75f-4e67-b940-41122eb815db" returned: 0 in 0.297s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-quobyte-84635bef-c75f-4e67-b940-41122eb815db" released by "_delete_snapshot" :: held 1.756s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:19 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fe86b170-653c-476e-bc52-4445863fe830" returned: 0 in 0.284s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-quobyte-b6040092-4668-439e-9678-ba337f09757e" released by "delete_snapshot" :: held 1.797s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-quobyte-fe86b170-653c-476e-bc52-4445863fe830" released by "delete_volume" :: held 0.845s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Created reservations ['1d6c7c9c-93d9-4b55-b2c8-9e58889cacb0', '4d29f424-2dc4-45c4-8b01-ff0267ea2f75', '39c3b52a-90cc-4c15-83d4-8fdd72f42209', '47579777-5a45-401d-927c-a9e2b8432ee0'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.quota [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Created reservations ['eb1700dc-c066-4f79-8fd3-2fd8f002e91c', '863a2c95-eb2a-4840-a9e5-155f28426988', '42e8fbd3-1238-4022-a0d3-0da28b480295', '778cf3f1-8608-4df1-a409-80b2135a282b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:19 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:19 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Delete snapshot completed successfully. Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-750f8d74-93ac-42f8-84f6-501da4bd108e req-97b76c90-dff5-4d45-a608-29574ccc1bce tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-84635bef-c75f-4e67-b940-41122eb815db-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Acquiring lock "cinder-b6040092-4668-439e-9678-ba337f09757e-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-b6040092-4668-439e-9678-ba337f09757e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:19 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.304s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Deleted volume successfully. Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Acquiring lock "cinder-quobyte-b6040092-4668-439e-9678-ba337f09757e" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-quobyte-b6040092-4668-439e-9678-ba337f09757e" acquired by "delete_volume" :: waited 0.028s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0cedf0af-77b9-4da9-99c0-41c97892fca7 tempest-AttachVolumeNegativeTest-1601447696 None] Lock "cinder-fe86b170-653c-476e-bc52-4445863fe830-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a42991-6f87-47f0-9bd4-fc36aaebba46]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:20 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e Sep 08 07:27:20 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Creating offline snapshot 4f075850-936d-4437-8402-f5ee6d68407f of volume 236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:27:20 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e" returned: 0 in 0.508s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[35554922-44f9-4b77-86c5-519ba1c476e0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:20 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e Sep 08 07:27:20 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:20 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c Sep 08 07:27:20 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f7572ff0-4c58-452b-9cf3-471d4fadc46a tempest-GroupsTest-1924038583 None] Group tempest-GroupsTest-Group-697569409: creating Sep 08 07:27:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f7572ff0-4c58-452b-9cf3-471d4fadc46a tempest-GroupsTest-1924038583 None] Group tempest-GroupsTest-Group-697569409: created successfully Sep 08 07:27:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f7572ff0-4c58-452b-9cf3-471d4fadc46a tempest-GroupsTest-1924038583 None] Create group completed successfully. Sep 08 07:27:20 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b6040092-4668-439e-9678-ba337f09757e" returned: 0 in 0.362s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-quobyte-b6040092-4668-439e-9678-ba337f09757e" released by "delete_volume" :: held 0.955s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG cinder.quota [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Created reservations ['7a600a6f-d7bd-4746-96fc-f683dd8d02c4', '688a44d1-4d53-4e96-b2ae-46d8a9ce9118', '4f58b930-091d-44ea-9e23-ad72de5df282', '50d62418-13cd-4921-a222-98faf9d00748'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:20 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c" returned: 0 in 0.479s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236726a5-8544-40e3-93a0-3120a8700402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:20 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f 1G Sep 08 07:27:20 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:21 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:21 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:21 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.294s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:21 devstack cinder-volume[87278]: DEBUG cinder.manager [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:21 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Deleted volume successfully. Sep 08 07:27:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-07e07aac-5263-4983-af66-9bc9b52c35d2 req-4d0dcbaa-0724-4faf-bdc7-9e80f06a2e47 tempest-VolumesSnapshotsTestJSON-1597135007 None] Lock "cinder-b6040092-4668-439e-9678-ba337f09757e-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:21 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f 1G" returned: 0 in 0.589s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:21 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f Sep 08 07:27:21 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:21 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f" returned: 0 in 0.357s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:21 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f is being set with open permissions: ugo+rw Sep 08 07:27:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:21 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f Sep 08 07:27:21 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:22 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f" returned: 0 in 0.350s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4f7510a1-bbcc-4e43-8467-48b4b285106f tempest-VolumesSnapshotListTestJSON-1794804704 None] Create snapshot completed successfully Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Flow 'volume_create_manager' (f78efd2b-84d3-4b9a-bacd-e73fcfa95042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36260bee-6ef4-484b-8f22-e69742c091a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36260bee-6ef4-484b-8f22-e69742c091a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-570651236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3aa2085-e0b0-468e-95b5-a2af3bbc45eb,host='devstack@QuobyteHD#QuobyteHD',id=2f88d9dc-4e87-4043-907e-2211857f25cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e957cbcd44ff46caae555cc4c932a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:22Z,use_quota=True,user_id='6e85c81fea904eb893458cde6921ffc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c03a10a-45af-4f81-948e-3c5fed3d35f2),volume_type_id=0c03a10a-45af-4f81-948e-3c5fed3d35f2)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba3a142-ab10-4c4e-a52e-7225ea91fd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba3a142-ab10-4c4e-a52e-7225ea91fd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f263bb-62c1-430e-93a2-94d62cf4bdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f263bb-62c1-430e-93a2-94d62cf4bdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f88d9dc-4e87-4043-907e-2211857f25cf', 'volume_name': 'volume-2f88d9dc-4e87-4043-907e-2211857f25cf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a664b0d4-bd2f-4d2b-b582-4fccf58520f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a664b0d4-bd2f-4d2b-b582-4fccf58520f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28702419-2d4f-4bac-a3ee-cfaad1cd178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:22 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Volume 2f88d9dc-4e87-4043-907e-2211857f25cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f88d9dc-4e87-4043-907e-2211857f25cf', 'volume_size': 1} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3aa2085-e0b0-468e-95b5-a2af3bbc45eb,created_at=2026-09-08T05:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-570651236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3aa2085-e0b0-468e-95b5-a2af3bbc45eb,host='devstack@QuobyteHD#QuobyteHD',id=2f88d9dc-4e87-4043-907e-2211857f25cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e957cbcd44ff46caae555cc4c932a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:22Z,use_quota=True,user_id='6e85c81fea904eb893458cde6921ffc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c03a10a-45af-4f81-948e-3c5fed3d35f2),volume_type_id=0c03a10a-45af-4f81-948e-3c5fed3d35f2)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Creating volume 2f88d9dc-4e87-4043-907e-2211857f25cf {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:22 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:22 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf 1073741824 Sep 08 07:27:22 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:23 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf 1073741824" returned: 0 in 0.489s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:23 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf Sep 08 07:27:23 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:23 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf" returned: 0 in 0.272s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.529s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28702419-2d4f-4bac-a3ee-cfaad1cd178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f88d9dc-4e87-4043-907e-2211857f25cf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6163c9-7af0-4210-a61d-a940870bde56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Creating offline snapshot 675c6efb-aafd-44b6-81a4-2b6b94bde991 of volume 236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:27:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Volume volume-2f88d9dc-4e87-4043-907e-2211857f25cf (2f88d9dc-4e87-4043-907e-2211857f25cf): created successfully Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6163c9-7af0-4210-a61d-a940870bde56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Flow 'volume_create_manager' (f78efd2b-84d3-4b9a-bacd-e73fcfa95042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa6a11c-9543-4934-a19c-e74a8954e878]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:23 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f3687987-e183-4d9d-bf5e-3aa88777c97f tempest-GroupsTest-1924038583 None] Created volume successfully. Sep 08 07:27:23 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f Sep 08 07:27:23 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:24 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f" returned: 0 in 0.528s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236726a5-8544-40e3-93a0-3120a8700402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:24 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 1G Sep 08 07:27:24 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Flow 'volume_create_manager' (f811c2e3-1d33-4ce2-a4b5-b282616926a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5d3fe8-4eb3-4a31-b2a3-365d550eb518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5d3fe8-4eb3-4a31-b2a3-365d550eb518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1155787376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3aa2085-e0b0-468e-95b5-a2af3bbc45eb,host='devstack@QuobyteHD#QuobyteHD',id=0be2e811-6c0e-4d82-a366-8553e16e5feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e957cbcd44ff46caae555cc4c932a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:24Z,use_quota=True,user_id='6e85c81fea904eb893458cde6921ffc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c03a10a-45af-4f81-948e-3c5fed3d35f2),volume_type_id=0c03a10a-45af-4f81-948e-3c5fed3d35f2)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d675d244-f5db-47cb-a1fd-30b8e73d94b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d675d244-f5db-47cb-a1fd-30b8e73d94b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207c9469-e249-451d-a68d-71f038505376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207c9469-e249-451d-a68d-71f038505376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be2e811-6c0e-4d82-a366-8553e16e5feb', 'volume_name': 'volume-0be2e811-6c0e-4d82-a366-8553e16e5feb', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7921f7c3-7214-4857-95f0-f7c538b7f6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7921f7c3-7214-4857-95f0-f7c538b7f6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2b21bc-e5be-46b0-b336-994cdcc1f326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:24 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Volume 0be2e811-6c0e-4d82-a366-8553e16e5feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be2e811-6c0e-4d82-a366-8553e16e5feb', 'volume_size': 1} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:24 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 1G" returned: 0 in 0.719s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:24 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 Sep 08 07:27:24 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:25 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991" returned: 0 in 0.391s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:25 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 is being set with open permissions: ugo+rw Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:25 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 Sep 08 07:27:25 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:25 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991" returned: 0 in 0.286s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.826s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3aa2085-e0b0-468e-95b5-a2af3bbc45eb,created_at=2026-09-08T05:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1155787376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3aa2085-e0b0-468e-95b5-a2af3bbc45eb,host='devstack@QuobyteHD#QuobyteHD',id=0be2e811-6c0e-4d82-a366-8553e16e5feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e957cbcd44ff46caae555cc4c932a05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:24Z,use_quota=True,user_id='6e85c81fea904eb893458cde6921ffc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c03a10a-45af-4f81-948e-3c5fed3d35f2),volume_type_id=0c03a10a-45af-4f81-948e-3c5fed3d35f2)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Creating volume 0be2e811-6c0e-4d82-a366-8553e16e5feb {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:25 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:25 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb 1073741824 Sep 08 07:27:25 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:25 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-248d832e-ed33-4fbf-963c-8514eac98295 tempest-VolumesSnapshotListTestJSON-1794804704 None] Create snapshot completed successfully Sep 08 07:27:26 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb 1073741824" returned: 0 in 0.563s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:26 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb Sep 08 07:27:26 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:26 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb" returned: 0 in 0.357s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2b21bc-e5be-46b0-b336-994cdcc1f326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be2e811-6c0e-4d82-a366-8553e16e5feb', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e07ddd2-dc6d-40bc-8d06-859a789b7596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Flow 'volume_create_manager' (7a56fd2f-f43f-43fd-9837-0089f29dabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5411661a-ad72-46e5-893c-5e03aacae774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Volume volume-0be2e811-6c0e-4d82-a366-8553e16e5feb (0be2e811-6c0e-4d82-a366-8553e16e5feb): created successfully Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e07ddd2-dc6d-40bc-8d06-859a789b7596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Flow 'volume_create_manager' (f811c2e3-1d33-4ce2-a4b5-b282616926a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5411661a-ad72-46e5-893c-5e03aacae774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1362759658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6adcf5-8f06-4a89-907e-76ca3ffecdb2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20abb5ed296d4ef385fbf38029790d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:26Z,use_quota=True,user_id='1e1b3fd8ef6f480e9306edda5dab212c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a962ae-7b61-46c4-a842-5e8465a0f6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a962ae-7b61-46c4-a842-5e8465a0f6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c978801-33bf-4e47-ad6f-c6e5cfe7edb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c978801-33bf-4e47-ad6f-c6e5cfe7edb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a6adcf5-8f06-4a89-907e-76ca3ffecdb2', 'volume_name': 'volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f56e767-51fc-4aad-be39-8bf2e5e53616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f56e767-51fc-4aad-be39-8bf2e5e53616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde0ef6e-3fa0-46f1-a7ff-68a6992f062a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Volume 1a6adcf5-8f06-4a89-907e-76ca3ffecdb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2', 'volume_size': 1} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1362759658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6adcf5-8f06-4a89-907e-76ca3ffecdb2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20abb5ed296d4ef385fbf38029790d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:26Z,use_quota=True,user_id='1e1b3fd8ef6f480e9306edda5dab212c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Creating volume 1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:26 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1a42681e-bb87-4c77-8681-31884183d52c tempest-GroupsTest-1924038583 None] Created volume successfully. Sep 08 07:27:26 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 1073741824 Sep 08 07:27:26 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-66d2f349-e998-4b49-82c2-4cd7608dec77 tempest-GroupsTest-1924038583 None] Update group completed successfully. Sep 08 07:27:27 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 1073741824" returned: 0 in 0.628s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:27 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 Sep 08 07:27:27 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-675c6efb-aafd-44b6-81a4-2b6b94bde991-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-675c6efb-aafd-44b6-81a4-2b6b94bde991-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-quobyte-675c6efb-aafd-44b6-81a4-2b6b94bde991" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-675c6efb-aafd-44b6-81a4-2b6b94bde991" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Deleting offline snapshot 675c6efb-aafd-44b6-81a4-2b6b94bde991 of volume 236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] snapshot_file for this snap is: volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[21385cbf-e20f-4f32-bb7c-37f3a67a57a6]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:27 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 Sep 08 07:27:27 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:27 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2" returned: 0 in 0.301s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde0ef6e-3fa0-46f1-a7ff-68a6992f062a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715b0ff1-6fcf-4bfb-ae66-966bc7990713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Volume volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 (1a6adcf5-8f06-4a89-907e-76ca3ffecdb2): created successfully Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715b0ff1-6fcf-4bfb-ae66-966bc7990713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Flow 'volume_create_manager' (7a56fd2f-f43f-43fd-9837-0089f29dabb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-d74e9cf8-b829-4c76-bc8d-07227282b988 req-828fe7eb-7c79-4418-9c0b-1dc5a8543d2f tempest-VolumesGetTestJSON-1471112018 None] Created volume successfully. Sep 08 07:27:27 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991" returned: 0 in 0.386s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236726a5-8544-40e3-93a0-3120a8700402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead111e2-3884-4320-b0af-b908a935a140]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:27 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f Sep 08 07:27:27 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:28 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f" returned: 0 in 0.387s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236726a5-8544-40e3-93a0-3120a8700402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:28 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 Sep 08 07:27:28 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:28 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4c491fa1-fbf2-44e7-9077-e77c190a5693 tempest-GroupsTest-1924038583 None] Update group completed successfully. Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:28 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Flow 'volume_create_manager' (2fde1fcd-8032-429a-a4dc-6e52813e2425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00b945b-2d91-41d8-84d3-42840557bc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991" returned: 0 in 0.519s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:28 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991 Sep 08 07:27:28 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00b945b-2d91-41d8-84d3-42840557bc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-66744606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777e8efa-d009-48c4-b3f7-66c331ed01bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd010e82ff5a470b997a455c35d52755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:29Z,use_quota=True,user_id='5f428ca5e7fd43298425db7c0a8882ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ba1c93-20e6-4580-a33a-29235b0bab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ba1c93-20e6-4580-a33a-29235b0bab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9147ce49-b6a4-4135-83ce-b191edbc1c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9147ce49-b6a4-4135-83ce-b191edbc1c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777e8efa-d009-48c4-b3f7-66c331ed01bb', 'volume_name': 'volume-777e8efa-d009-48c4-b3f7-66c331ed01bb', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f88ff4d-c5ea-4105-841e-0ae387968f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f88ff4d-c5ea-4105-841e-0ae387968f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5476714b-8082-40d3-b9a4-c13c66750cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:28 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Volume 777e8efa-d009-48c4-b3f7-66c331ed01bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777e8efa-d009-48c4-b3f7-66c331ed01bb', 'volume_size': 1} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-66744606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777e8efa-d009-48c4-b3f7-66c331ed01bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd010e82ff5a470b997a455c35d52755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:29Z,use_quota=True,user_id='5f428ca5e7fd43298425db7c0a8882ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Creating volume 777e8efa-d009-48c4-b3f7-66c331ed01bb {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:28 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:28 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb 1073741824 Sep 08 07:27:28 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:29 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.675c6efb-aafd-44b6-81a4-2b6b94bde991" returned: 0 in 0.255s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-675c6efb-aafd-44b6-81a4-2b6b94bde991" released by "_delete_snapshot" :: held 1.648s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" released by "delete_snapshot" :: held 1.670s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Acquiring lock "cinder-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Lock "cinder-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Created reservations ['a7e2aab3-adf5-49a0-852f-652319827e3b', '5246d133-2309-4635-901a-72a2b225ce6d', '406c5fe8-fb1e-41d4-b750-1178359e9660', '333244e1-647c-4f93-8e4a-6a8b55063260'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Acquiring lock "cinder-quobyte-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Lock "cinder-quobyte-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2" acquired by "delete_volume" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[559a4a05-c047-4d14-812a-235a7ec43ae1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:29 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Delete snapshot completed successfully. Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-39343804-a894-40af-8483-dd8937dcbefb tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-675c6efb-aafd-44b6-81a4-2b6b94bde991-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:29 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb 1073741824" returned: 0 in 0.490s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:29 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 Sep 08 07:27:29 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:29 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb Sep 08 07:27:29 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-4f075850-936d-4437-8402-f5ee6d68407f-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:29 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2" returned: 0 in 0.411s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-4f075850-936d-4437-8402-f5ee6d68407f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:29 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2 Sep 08 07:27:29 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:29 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-quobyte-4f075850-936d-4437-8402-f5ee6d68407f" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb" returned: 0 in 0.342s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-4f075850-936d-4437-8402-f5ee6d68407f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Deleting offline snapshot 4f075850-936d-4437-8402-f5ee6d68407f of volume 236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] snapshot_file for this snap is: volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5476714b-8082-40d3-b9a4-c13c66750cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777e8efa-d009-48c4-b3f7-66c331ed01bb', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3d1c49-910b-4e53-8e80-2b5cd7d00bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caf465d-5e05-4876-bbc1-54bed173007d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:29 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Volume volume-777e8efa-d009-48c4-b3f7-66c331ed01bb (777e8efa-d009-48c4-b3f7-66c331ed01bb): created successfully Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3d1c49-910b-4e53-8e80-2b5cd7d00bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Flow 'volume_create_manager' (2fde1fcd-8032-429a-a4dc-6e52813e2425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:29 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0ee59790-e4ad-4c57-bfe2-15fd0bb1fce8 tempest-VolumesTestJSON-334101789 None] Created volume successfully. Sep 08 07:27:29 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f Sep 08 07:27:29 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:29 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2" returned: 0 in 0.305s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Lock "cinder-quobyte-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2" released by "delete_volume" :: held 0.763s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG cinder.quota [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Created reservations ['cb33719c-a608-401f-8593-60b7ee0c2ac2', 'e7b6bfe8-aae7-4309-ae5b-042180240218', 'b964b3e1-6c7a-4cf1-a0e9-c42d87dce363', 'fec72dd5-3cdb-42b6-af41-eac43d45a919'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:30 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:30 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:30 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f" returned: 0 in 0.439s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236726a5-8544-40e3-93a0-3120a8700402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b442923-cb98-4974-8e81-659ee2ab3726]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Acquiring lock "cinder-quobyte-0be2e811-6c0e-4d82-a366-8553e16e5feb" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Lock "cinder-quobyte-0be2e811-6c0e-4d82-a366-8553e16e5feb" acquired by "delete_volume" :: waited 0.035s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9acab7-e85e-499e-8851-1326a83b9675]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:30 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c Sep 08 07:27:30 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:30 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.339s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG cinder.manager [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:30 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Deleted volume successfully. Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-a0c0547e-4b34-4234-aebd-b5e9c20bc343 req-782efa7c-d5fe-4da3-8bf1-73c0abd141ad tempest-VolumesGetTestJSON-1471112018 None] Lock "cinder-1a6adcf5-8f06-4a89-907e-76ca3ffecdb2-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:30 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb Sep 08 07:27:30 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:30 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c" returned: 0 in 0.412s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236726a5-8544-40e3-93a0-3120a8700402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:30 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f Sep 08 07:27:30 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:30 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb" returned: 0 in 0.517s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:30 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb Sep 08 07:27:30 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:31 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f" returned: 0 in 0.493s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:31 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f Sep 08 07:27:31 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:31 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0be2e811-6c0e-4d82-a366-8553e16e5feb" returned: 0 in 0.410s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Lock "cinder-quobyte-0be2e811-6c0e-4d82-a366-8553e16e5feb" released by "delete_volume" :: held 1.004s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Acquiring lock "cinder-quobyte-2f88d9dc-4e87-4043-907e-2211857f25cf" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Lock "cinder-quobyte-2f88d9dc-4e87-4043-907e-2211857f25cf" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e932452b-d4c2-4ed5-a67d-e5371db52c87]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:31 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf Sep 08 07:27:31 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:31 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.4f075850-936d-4437-8402-f5ee6d68407f" returned: 0 in 0.456s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-4f075850-936d-4437-8402-f5ee6d68407f" released by "_delete_snapshot" :: held 1.957s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" released by "delete_snapshot" :: held 2.003s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Flow 'volume_create_manager' (32cc06c9-e78a-4035-86ab-e81898c91885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0994bd-7935-435a-a200-a3ca08d6977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0994bd-7935-435a-a200-a3ca08d6977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-473525898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8935d4-6c49-4fc6-8c3e-261db8546a78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd010e82ff5a470b997a455c35d52755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:32Z,use_quota=True,user_id='5f428ca5e7fd43298425db7c0a8882ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa703b47-be4b-4e41-901a-c66747789805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa703b47-be4b-4e41-901a-c66747789805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2784e6-a308-4bb4-8f6d-0afc45fda22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2784e6-a308-4bb4-8f6d-0afc45fda22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8935d4-6c49-4fc6-8c3e-261db8546a78', 'volume_name': 'volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefc6c4b-d9ce-471a-a3f6-217a14849dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefc6c4b-d9ce-471a-a3f6-217a14849dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd91695-7985-4016-b2f6-e0286c7a6186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:31 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Volume 2b8935d4-6c49-4fc6-8c3e-261db8546a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78', 'volume_size': 1} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-473525898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8935d4-6c49-4fc6-8c3e-261db8546a78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd010e82ff5a470b997a455c35d52755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:32Z,use_quota=True,user_id='5f428ca5e7fd43298425db7c0a8882ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Creating volume 2b8935d4-6c49-4fc6-8c3e-261db8546a78 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:31 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:31 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 1073741824 Sep 08 07:27:31 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Created reservations ['4c611622-4eab-4509-9549-77d386a78510', '05a7dd28-2369-4b38-9cdc-dfe81dabb626', '1a0e6ba3-115e-4d36-ba0d-2acb0db8c076', '4a2d6d2e-69d2-4780-bc32-e06ddcb5f809'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:31 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf" returned: 0 in 0.540s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:31 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf Sep 08 07:27:31 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Delete snapshot completed successfully. Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-964ee133-244b-4794-aa2d-6086cba9d70f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-4f075850-936d-4437-8402-f5ee6d68407f-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:32 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2f88d9dc-4e87-4043-907e-2211857f25cf" returned: 0 in 0.313s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Lock "cinder-quobyte-2f88d9dc-4e87-4043-907e-2211857f25cf" released by "delete_volume" :: held 0.913s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Created reservations ['e754484a-b957-4902-b470-c83bc94062a2'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:32 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 1073741824" returned: 0 in 0.545s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:32 devstack cinder-volume[87278]: WARNING cinder.quota [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1403919403 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1403919403, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:27:32 devstack cinder-volume[87278]: WARNING cinder.quota [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1403919403 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1403919403, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Created reservations ['9cade12e-5566-4e1a-992b-5de52972cc0b', '5d3680da-b005-4f7c-bb53-125718e63bc9', '596bfe93-29b6-45a3-8256-159223420431', '18960c2c-2fb4-4b14-9031-8f21b560e318'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:32 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 Sep 08 07:27:32 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Created reservations ['2e2b1b73-c93f-4efe-96f7-fdf76fbd1e72', 'b0be0e19-e60a-4c9c-85d3-36d6d5800fa4', '3c6442e7-a2aa-4d3e-a416-d168ac331cd6', '44570cd0-df7c-4f81-afad-31a11c476f81'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:32 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78" returned: 0 in 0.264s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd91695-7985-4016-b2f6-e0286c7a6186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0c8d6b-31c0-46e7-861e-d8747deac1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:32 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Volume volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 (2b8935d4-6c49-4fc6-8c3e-261db8546a78): created successfully Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0c8d6b-31c0-46e7-861e-d8747deac1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:32 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:32 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Flow 'volume_create_manager' (32cc06c9-e78a-4035-86ab-e81898c91885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8a383070-e4b4-4ccd-8c0d-5211cec54395 tempest-VolumesTestJSON-334101789 None] Created volume successfully. Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-74a39e69-5b82-4b05-af66-e382ea1f298c-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-74a39e69-5b82-4b05-af66-e382ea1f298c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-quobyte-74a39e69-5b82-4b05-af66-e382ea1f298c" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-74a39e69-5b82-4b05-af66-e382ea1f298c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Deleting offline snapshot 74a39e69-5b82-4b05-af66-e382ea1f298c of volume 236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:27:33 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] snapshot_file for this snap is: volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.363s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:33 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0948aebb-1e1c-4acd-b5e8-449e5d6739db tempest-GroupsTest-1924038583 None] Delete group completed successfully. Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[313cba4f-d04d-4f63-9abb-548e0b45d5b6]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:33 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c Sep 08 07:27:33 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:33 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c" returned: 0 in 0.396s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236726a5-8544-40e3-93a0-3120a8700402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3422794-eaab-4e6a-a31d-733437b2a3b7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:33 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 Sep 08 07:27:33 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:34 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402" returned: 0 in 0.420s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:34 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c Sep 08 07:27:34 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Flow 'volume_create_manager' (c2c29d9c-18d4-4780-96dd-3d00bbde3ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9725344e-b8b3-4e38-acbc-efb1ec0b9151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9725344e-b8b3-4e38-acbc-efb1ec0b9151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1883203849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75202342-5e53-4375-a33e-e4b19043ec4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd010e82ff5a470b997a455c35d52755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:34Z,use_quota=True,user_id='5f428ca5e7fd43298425db7c0a8882ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e61b03-c3c0-49c0-b29e-8b360ce6665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e61b03-c3c0-49c0-b29e-8b360ce6665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9520e887-4796-46c9-8d9b-fb4794f040cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9520e887-4796-46c9-8d9b-fb4794f040cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75202342-5e53-4375-a33e-e4b19043ec4b', 'volume_name': 'volume-75202342-5e53-4375-a33e-e4b19043ec4b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fbcf50-72f7-4ffe-ba6e-f1e0ae8342ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fbcf50-72f7-4ffe-ba6e-f1e0ae8342ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9342450-9d98-4b11-8a0c-514dcf25f0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:34 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Volume 75202342-5e53-4375-a33e-e4b19043ec4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75202342-5e53-4375-a33e-e4b19043ec4b', 'volume_size': 1} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1883203849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75202342-5e53-4375-a33e-e4b19043ec4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd010e82ff5a470b997a455c35d52755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:34Z,use_quota=True,user_id='5f428ca5e7fd43298425db7c0a8882ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Creating volume 75202342-5e53-4375-a33e-e4b19043ec4b {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:34 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:34 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:34 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b 1073741824 Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c" returned: 0 in 0.445s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:34 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:34 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c Sep 08 07:27:34 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:34 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402.74a39e69-5b82-4b05-af66-e382ea1f298c" returned: 0 in 0.313s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-74a39e69-5b82-4b05-af66-e382ea1f298c" released by "_delete_snapshot" :: held 1.742s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" released by "delete_snapshot" :: held 1.775s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Created reservations ['ead48a36-67fe-4399-a9b3-b47402bb67b3', 'a657b1f1-00b0-47cf-a6dd-4569d7ebf87d', 'ec20def5-f2ec-405d-b526-777d03130c86', '472cb859-5665-4084-abf8-02205d7613c5'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:34 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Delete snapshot completed successfully. Sep 08 07:27:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2a1acd60-1b76-4458-8304-5511774d041c tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-74a39e69-5b82-4b05-af66-e382ea1f298c-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:35 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b 1073741824" returned: 0 in 0.613s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:35 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b Sep 08 07:27:35 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:35 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b" returned: 0 in 0.330s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-236726a5-8544-40e3-93a0-3120a8700402-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9342450-9d98-4b11-8a0c-514dcf25f0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75202342-5e53-4375-a33e-e4b19043ec4b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aa6ba0-8730-4845-bc84-8d428f356064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-236726a5-8544-40e3-93a0-3120a8700402-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:35 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Volume volume-75202342-5e53-4375-a33e-e4b19043ec4b (75202342-5e53-4375-a33e-e4b19043ec4b): created successfully Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aa6ba0-8730-4845-bc84-8d428f356064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Flow 'volume_create_manager' (c2c29d9c-18d4-4780-96dd-3d00bbde3ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6ccbcc6f-8137-4dc2-98c7-f29cdfb659df tempest-VolumesTestJSON-334101789 None] Created volume successfully. Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb2bc98-411c-4075-9787-1ed82e4fdfaf]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:35 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 Sep 08 07:27:35 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:35 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402" returned: 0 in 0.390s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:36 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402 Sep 08 07:27:36 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:36 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-236726a5-8544-40e3-93a0-3120a8700402" returned: 0 in 0.276s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-quobyte-236726a5-8544-40e3-93a0-3120a8700402" released by "delete_volume" :: held 0.742s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Created reservations ['64c0c198-4fb8-40b2-b223-f7c5bb6a146b', '2722d3a2-9eed-4811-b458-686fc2f24bbe', 'e33e507c-71af-4b61-a773-7ecd38fcb2b5', '8d4aec68-2466-4d55-b7b2-1659431c68e9'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:36 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:36 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:36 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.274s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:36 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Deleted volume successfully. Sep 08 07:27:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b6cf6a07-9c99-4927-9b11-81d85615ea3f tempest-VolumesSnapshotListTestJSON-1794804704 None] Lock "cinder-236726a5-8544-40e3-93a0-3120a8700402-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Acquiring lock "cinder-75202342-5e53-4375-a33e-e4b19043ec4b-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Lock "cinder-75202342-5e53-4375-a33e-e4b19043ec4b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Acquiring lock "cinder-quobyte-75202342-5e53-4375-a33e-e4b19043ec4b" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Lock "cinder-quobyte-75202342-5e53-4375-a33e-e4b19043ec4b" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:37 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ede604c-a8fe-49e6-97e4-e81bc166c976]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:37 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b Sep 08 07:27:37 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:38 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:38 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b Sep 08 07:27:38 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:38 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75202342-5e53-4375-a33e-e4b19043ec4b" returned: 0 in 0.316s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Lock "cinder-quobyte-75202342-5e53-4375-a33e-e4b19043ec4b" released by "delete_volume" :: held 0.774s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Created reservations ['714e150d-d68c-41be-b98a-52a32d36f038', '507177b8-1f78-4b28-9f19-c049d1dbeab4', 'd54feae5-c21e-4f77-8e0d-a20a8ed63048', '07a8bc4c-4e58-4554-846d-5de4fe1931a2'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:38 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:38 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Acquiring lock "cinder-2b8935d4-6c49-4fc6-8c3e-261db8546a78-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Lock "cinder-2b8935d4-6c49-4fc6-8c3e-261db8546a78-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Acquiring lock "cinder-quobyte-2b8935d4-6c49-4fc6-8c3e-261db8546a78" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Lock "cinder-quobyte-2b8935d4-6c49-4fc6-8c3e-261db8546a78" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6970f37b-b093-4be2-8906-4da1323e3a9a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:38 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.429s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:38 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Deleted volume successfully. Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ae23ec00-245a-4eff-bed5-f4c4d286b049 tempest-VolumesTestJSON-334101789 None] Lock "cinder-75202342-5e53-4375-a33e-e4b19043ec4b-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:39 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 Sep 08 07:27:39 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:39 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78" returned: 0 in 0.480s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:39 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78 Sep 08 07:27:39 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:39 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2b8935d4-6c49-4fc6-8c3e-261db8546a78" returned: 0 in 0.307s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Lock "cinder-quobyte-2b8935d4-6c49-4fc6-8c3e-261db8546a78" released by "delete_volume" :: held 0.835s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Created reservations ['39ce1716-b7b8-40ed-938a-51777c9528d4', '5572b930-f001-4df4-a1eb-af361b3414d9', 'dbd33e1a-9cc6-4189-86cb-b042ecd811c5', 'faa2fe55-492b-462a-b932-63d4c4c5f157'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:39 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:39 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Acquiring lock "cinder-777e8efa-d009-48c4-b3f7-66c331ed01bb-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Lock "cinder-777e8efa-d009-48c4-b3f7-66c331ed01bb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Acquiring lock "cinder-quobyte-777e8efa-d009-48c4-b3f7-66c331ed01bb" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Lock "cinder-quobyte-777e8efa-d009-48c4-b3f7-66c331ed01bb" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9228d203-e866-4326-8090-ef48b51cc19f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:40 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.499s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Deleted volume successfully. Sep 08 07:27:40 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb Sep 08 07:27:40 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c34c4cf-66d6-4b53-a003-d98011786979 tempest-VolumesTestJSON-334101789 None] Lock "cinder-2b8935d4-6c49-4fc6-8c3e-261db8546a78-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:40 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb" returned: 0 in 0.486s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:40 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb Sep 08 07:27:40 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:41 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-777e8efa-d009-48c4-b3f7-66c331ed01bb" returned: 0 in 0.327s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Lock "cinder-quobyte-777e8efa-d009-48c4-b3f7-66c331ed01bb" released by "delete_volume" :: held 0.875s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Created reservations ['fe135906-7d73-4265-9fd5-dff78bff5f7e', '1117fd26-ad20-4bc8-a081-0e561c5afb21', 'f4834e68-4409-4622-8a9d-f09e110cd34b', '73b3d58f-2a32-454b-bcfa-70a72f1b258f'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:41 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:41 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:41 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.342s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Deleted volume successfully. Sep 08 07:27:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-971ff875-5c03-4377-a3c4-b5cc4f27d766 tempest-VolumesTestJSON-334101789 None] Lock "cinder-777e8efa-d009-48c4-b3f7-66c331ed01bb-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-43f9fce4-3a25-46a0-872a-4b676f16faa9 tempest-GroupsV314Test-1174238194 None] Group tempest-GroupsV314Test-Group-130867709: creating Sep 08 07:27:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-43f9fce4-3a25-46a0-872a-4b676f16faa9 tempest-GroupsV314Test-1174238194 None] Group tempest-GroupsV314Test-Group-130867709: created successfully Sep 08 07:27:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-43f9fce4-3a25-46a0-872a-4b676f16faa9 tempest-GroupsV314Test-1174238194 None] Create group completed successfully. Sep 08 07:27:43 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Flow 'volume_create_manager' (09d0504f-2dbc-457b-9c69-fcc299422bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a26a10-0a69-4ed0-ad9d-55249820e513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a26a10-0a69-4ed0-ad9d-55249820e513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1088800060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fb7c65c-e392-47a9-a3ed-f88bea097941,host='devstack@QuobyteHD#QuobyteHD',id=eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2593c616c2474d4e94f9068d22ae9426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:44Z,use_quota=True,user_id='7dd370578ef845fc9fa41d1be3a900bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f739d386-368e-4939-a7d7-7e8964299af0),volume_type_id=f739d386-368e-4939-a7d7-7e8964299af0)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9b8f63-635d-4fbb-a1a0-8ffd94986982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9b8f63-635d-4fbb-a1a0-8ffd94986982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19733596-5eb3-4d1c-822e-2ec3506a035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19733596-5eb3-4d1c-822e-2ec3506a035a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0', 'volume_name': 'volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ec8360-75ff-4cb1-97b7-551bf2867048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ec8360-75ff-4cb1-97b7-551bf2867048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8b7f09-fee7-415a-af99-ac796024e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:44 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Volume eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0', 'volume_size': 1} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1fb7c65c-e392-47a9-a3ed-f88bea097941,created_at=2026-09-08T05:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1088800060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fb7c65c-e392-47a9-a3ed-f88bea097941,host='devstack@QuobyteHD#QuobyteHD',id=eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2593c616c2474d4e94f9068d22ae9426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:27:44Z,use_quota=True,user_id='7dd370578ef845fc9fa41d1be3a900bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f739d386-368e-4939-a7d7-7e8964299af0),volume_type_id=f739d386-368e-4939-a7d7-7e8964299af0)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Creating volume eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:27:44 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:44 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 1073741824 Sep 08 07:27:44 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:44 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:27:44 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:44 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 1073741824" returned: 0 in 0.597s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:44 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 Sep 08 07:27:44 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:45 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.442s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:27:45 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0" returned: 0 in 0.452s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8b7f09-fee7-415a-af99-ac796024e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab11b9a-19a5-4eb5-8875-c2e9d12af667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:27:45 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Volume volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 (eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0): created successfully Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab11b9a-19a5-4eb5-8875-c2e9d12af667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:27:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Flow 'volume_create_manager' (09d0504f-2dbc-457b-9c69-fcc299422bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:27:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8d8cfcd1-7163-4a2e-956a-d028dae6cfee tempest-GroupsV314Test-1174238194 None] Created volume successfully. Sep 08 07:27:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:47 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Cloning volume eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 to volume 6896b741-6c84-41e1-8348-0b909e4f25c5 Sep 08 07:27:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Creating offline snapshot c1444602-39a1-453b-baa6-b647662faf18 of volume eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:27:47 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cef8364-9396-4b0c-8f99-7395dead9e86]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:47 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 Sep 08 07:27:47 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:47 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0" returned: 0 in 0.523s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:47 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 1G Sep 08 07:27:47 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:48 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92d8fdc4-a0d3-45df-83ea-862d69fdaac6 tempest-BackendsCapabilitiesAdminTestsJSON-789550739 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.531265258789, 'free_capacity_gb': 1773.531265258789, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87278) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 07:27:48 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dbca3248-2153-4fb4-9259-c6db956445e5 tempest-BackendsCapabilitiesAdminTestsJSON-789550739 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.531265258789, 'free_capacity_gb': 1773.531265258789, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87278) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 07:27:48 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 1G" returned: 0 in 0.567s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:48 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 Sep 08 07:27:48 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:48 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18" returned: 0 in 0.404s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:48 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:27:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:48 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 Sep 08 07:27:48 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:49 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18" returned: 0 in 0.389s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:49 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.info Sep 08 07:27:49 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:49 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.info" returned: 0 in 0.387s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:49 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:27:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:49 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.info Sep 08 07:27:49 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:50 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.info" returned: 0 in 0.360s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Acquiring lock "cinder-quobyte-6896b741-6c84-41e1-8348-0b909e4f25c5" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Lock "cinder-quobyte-6896b741-6c84-41e1-8348-0b909e4f25c5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] snapshot: c1444602-39a1-453b-baa6-b647662faf18, volume: 6896b741-6c84-41e1-8348-0b909e4f25c5, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd904ac-7893-4bdf-b77b-58e1232d329f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:50 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 Sep 08 07:27:50 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:50 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18" returned: 0 in 0.459s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[682ae2a2-484f-4116-b239-fb712e3df2c4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:50 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 Sep 08 07:27:50 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:51 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0" returned: 0 in 0.436s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:27:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:27:51 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:27:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:51 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 Sep 08 07:27:51 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:57 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5" returned: 0 in 6.188s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:27:57 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Converted 1024.00 MB image at 165.44 MB/s Sep 08 07:27:57 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:57 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 Sep 08 07:27:57 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:57 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5" returned: 0 in 0.315s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Lock "cinder-quobyte-6896b741-6c84-41e1-8348-0b909e4f25c5" released by "_copy_volume_from_snapshot" :: held 7.508s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Acquiring lock "cinder-quobyte-c1444602-39a1-453b-baa6-b647662faf18" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Lock "cinder-quobyte-c1444602-39a1-453b-baa6-b647662faf18" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Deleting offline snapshot c1444602-39a1-453b-baa6-b647662faf18 of volume eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] snapshot_file for this snap is: volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e26416e-cce1-42c4-ba02-00aff380e86c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:57 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 Sep 08 07:27:57 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:58 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18" returned: 0 in 0.597s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:27:58 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d2ca7d-d5d6-4bc2-ac31-40345fcc7ebb]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:27:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:58 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 Sep 08 07:27:58 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:59 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0" returned: 0 in 0.707s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:59 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 Sep 08 07:27:59 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:59 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=153,cinder:INSERT=45,cinder:UPDATE=194,cinder:DELETE=13 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:27:59 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18" returned: 0 in 0.383s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:27:59 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18 Sep 08 07:27:59 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:27:59 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 08 07:27:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0.c1444602-39a1-453b-baa6-b647662faf18" returned: 0 in 0.285s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:27:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Lock "cinder-quobyte-c1444602-39a1-453b-baa6-b647662faf18" released by "_delete_snapshot" :: held 2.116s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:27:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.578s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:27:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b21d82b5-8359-4fc2-bda6-efaf03d62eb6 tempest-GroupsV314Test-1174238194 None] Create group from source-group-1fb7c65c-e392-47a9-a3ed-f88bea097941 completed successfully. Sep 08 07:28:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Acquiring lock "cinder-quobyte-6896b741-6c84-41e1-8348-0b909e4f25c5" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bec00f27-48ed-4095-aad6-061410032c9b tempest-GroupsV320Test-179250720 None] Group tempest-GroupsV320Test-Group-1988730576: creating Sep 08 07:28:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Lock "cinder-quobyte-6896b741-6c84-41e1-8348-0b909e4f25c5" acquired by "delete_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bec00f27-48ed-4095-aad6-061410032c9b tempest-GroupsV320Test-179250720 None] Group tempest-GroupsV320Test-Group-1988730576: created successfully Sep 08 07:28:01 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a89b2c-a220-4a36-b865-86d2d2432de0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bec00f27-48ed-4095-aad6-061410032c9b tempest-GroupsV320Test-179250720 None] Create group completed successfully. Sep 08 07:28:01 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 Sep 08 07:28:01 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:01 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5" returned: 0 in 0.421s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:02 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5 Sep 08 07:28:02 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:02 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6896b741-6c84-41e1-8348-0b909e4f25c5" returned: 0 in 0.269s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Lock "cinder-quobyte-6896b741-6c84-41e1-8348-0b909e4f25c5" released by "delete_volume" :: held 0.751s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Created reservations ['30034176-9b0d-4070-8021-60eaad0b5294'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:02 devstack cinder-volume[87278]: WARNING cinder.quota [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1675353388 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1675353388, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:28:02 devstack cinder-volume[87278]: WARNING cinder.quota [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1675353388 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1675353388, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Created reservations ['03f0782f-0a3c-433c-bfc4-12066ed2e3db', '5faff514-79c1-4a33-b689-b1bb485eac9a', '154f3a5d-3f8b-4e17-9652-af48c88d4892', '97ea7db3-3217-4627-ad26-ab78aa99d172'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:02 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:02 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Acquiring lock "cinder-quobyte-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Lock "cinder-quobyte-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0" acquired by "delete_volume" :: waited 0.039s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:03 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.547s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:03 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-99120bd3-942f-4499-bd48-384861fcc385 tempest-GroupsV314Test-1174238194 None] Delete group completed successfully. Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b0d753-af86-47d9-9c3e-9e3d77f1428d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=182,cinder:INSERT=46,cinder:UPDATE=196,cinder:DELETE=13 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] Created reservations ['15bd4ae3-4e29-499b-a992-24ae73081589'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:03 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 Sep 08 07:28:03 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:03 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:03 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:03 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.280s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:03 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d49844b2-fcdd-4943-b221-bf7659597b02 tempest-GroupsV320Test-179250720 None] Delete group completed successfully. Sep 08 07:28:03 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0" returned: 0 in 0.493s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:03 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0 Sep 08 07:28:03 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:03 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0" returned: 0 in 0.288s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Lock "cinder-quobyte-eab82a8b-151a-4bf1-8ba0-cac8b92fd8d0" released by "delete_volume" :: held 0.872s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Created reservations ['95da9773-e287-49df-a3fc-a29d85401dc0'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Created reservations ['107f9fdf-3dce-4545-aa0f-47762e557f2d', 'dbfcfc84-b3ac-4bf9-b5cc-0022c474986a', '24185fb4-8a85-413b-97c7-a6ede06409df', 'b6fe89b4-1c51-4c65-b6d0-3b9cec6fcb4b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:04 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:04 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:04 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.330s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:04 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-77202c22-b71c-4d6e-9a19-305870c89a64 tempest-GroupsV314Test-1174238194 None] Delete group completed successfully. Sep 08 07:28:09 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:28:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Flow 'volume_create_manager' (6f75dd39-65a4-4181-ae58-b3aaa7189831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f82166-7307-4744-a19b-4c2ae64374fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f82166-7307-4744-a19b-4c2ae64374fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1394420904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca49ddea-1238-47b6-8807-53397b61bb11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9b97d517046019dbfba240fb5cdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:10Z,use_quota=True,user_id='5ef8daded4164ea59721525d37ff11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a325700e-ac26-4d5a-9143-1ad761697803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a325700e-ac26-4d5a-9143-1ad761697803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f6087a-2890-4d50-9bb6-758da02b4ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f6087a-2890-4d50-9bb6-758da02b4ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca49ddea-1238-47b6-8807-53397b61bb11', 'volume_name': 'volume-ca49ddea-1238-47b6-8807-53397b61bb11', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bd8dc4-522e-4da8-8a47-c26e4a080473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bd8dc4-522e-4da8-8a47-c26e4a080473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04303df-fd1c-44d5-bff5-6e1e7fa1917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:10 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Volume ca49ddea-1238-47b6-8807-53397b61bb11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca49ddea-1238-47b6-8807-53397b61bb11', 'volume_size': 1} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1394420904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca49ddea-1238-47b6-8807-53397b61bb11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9b97d517046019dbfba240fb5cdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:10Z,use_quota=True,user_id='5ef8daded4164ea59721525d37ff11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Creating volume ca49ddea-1238-47b6-8807-53397b61bb11 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:28:10 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:10 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11 1073741824 Sep 08 07:28:10 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:10 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11 1073741824" returned: 0 in 0.676s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:10 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11 Sep 08 07:28:10 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:11 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11" returned: 0 in 0.409s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:28:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04303df-fd1c-44d5-bff5-6e1e7fa1917e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca49ddea-1238-47b6-8807-53397b61bb11', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae89e0e-24cb-4251-9988-0f4f27b5be12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:11 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Volume volume-ca49ddea-1238-47b6-8807-53397b61bb11 (ca49ddea-1238-47b6-8807-53397b61bb11): created successfully Sep 08 07:28:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae89e0e-24cb-4251-9988-0f4f27b5be12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Flow 'volume_create_manager' (6f75dd39-65a4-4181-ae58-b3aaa7189831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:11 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7daccd3e-6271-4d75-a51a-44f8d46b0a12 tempest-VolumeQuotasAdminTestJSON-715410457 None] Created volume successfully. Sep 08 07:28:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Acquiring lock "cinder-ca49ddea-1238-47b6-8807-53397b61bb11-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "cinder-ca49ddea-1238-47b6-8807-53397b61bb11-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Acquiring lock "cinder-quobyte-ca49ddea-1238-47b6-8807-53397b61bb11" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "cinder-quobyte-ca49ddea-1238-47b6-8807-53397b61bb11" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:12 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4305ce-5794-4579-9182-afd4dc803ca1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:12 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11 Sep 08 07:28:12 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:12 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11" returned: 0 in 0.464s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:12 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11 Sep 08 07:28:12 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:13 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ca49ddea-1238-47b6-8807-53397b61bb11" returned: 0 in 0.291s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "cinder-quobyte-ca49ddea-1238-47b6-8807-53397b61bb11" released by "delete_volume" :: held 0.840s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Created reservations ['75ce9739-c7e9-4845-8f67-8d9ce5e6eaf7', 'c2ef1d91-c3ab-4337-aacf-9eb61583abf7', '75cf5f70-168d-44c2-89cb-4b3548d865bc', '76d05c50-21aa-469b-91db-d6ab6b845973'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:13 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:13 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:13 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.366s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:13 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Deleted volume successfully. Sep 08 07:28:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c8024521-21e3-4f35-ae12-3b905917e4d8 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "cinder-ca49ddea-1238-47b6-8807-53397b61bb11-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Flow 'volume_create_manager' (f03bf8e1-9518-4233-b79d-88263cc8bf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14963d0c-8f33-474e-a607-0e250b11d3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14963d0c-8f33-474e-a607-0e250b11d3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-47361642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859b979a-58f8-4c07-8414-07e6ffbeb2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9b97d517046019dbfba240fb5cdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:14Z,use_quota=True,user_id='5ef8daded4164ea59721525d37ff11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bee3b0-c070-4e6c-b83d-c051a6c958d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bee3b0-c070-4e6c-b83d-c051a6c958d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054db86e-e0ca-42ec-b3a1-0ea371e7be26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054db86e-e0ca-42ec-b3a1-0ea371e7be26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859b979a-58f8-4c07-8414-07e6ffbeb2d6', 'volume_name': 'volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3d9f73-b782-4965-bfec-9368457eb6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3d9f73-b782-4965-bfec-9368457eb6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7df5cd-f279-4c1a-b10b-5547c7130579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Volume 859b979a-58f8-4c07-8414-07e6ffbeb2d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6', 'volume_size': 1} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-47361642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859b979a-58f8-4c07-8414-07e6ffbeb2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9b97d517046019dbfba240fb5cdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:14Z,use_quota=True,user_id='5ef8daded4164ea59721525d37ff11e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Creating volume 859b979a-58f8-4c07-8414-07e6ffbeb2d6 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:28:14 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:28:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:14 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 1073741824 Sep 08 07:28:14 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:15 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 1073741824" returned: 0 in 0.590s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:15 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 Sep 08 07:28:15 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Flow 'volume_create_manager' (8b454117-3117-49a5-9858-bf596e1e7bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7ce0b5-67b8-4190-872e-e85795d332d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7ce0b5-67b8-4190-872e-e85795d332d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-851072755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeacdca1-5d0d-431c-abe9-96834739aa27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf317dc4beb41c0b24913edf54cfdd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:15Z,use_quota=True,user_id='781620caa62240ef8f7f955bc380c3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:15 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794544bc-ee91-4ab5-8d5a-352cc2bf0687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794544bc-ee91-4ab5-8d5a-352cc2bf0687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a39835-aeb1-491d-a03e-b07309ca152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a39835-aeb1-491d-a03e-b07309ca152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeacdca1-5d0d-431c-abe9-96834739aa27', 'volume_name': 'volume-aeacdca1-5d0d-431c-abe9-96834739aa27', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407e563e-d0d1-4add-9140-71d35617d856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407e563e-d0d1-4add-9140-71d35617d856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0dff97-6276-4005-b0d9-aa06e73e80c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:15 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Volume aeacdca1-5d0d-431c-abe9-96834739aa27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeacdca1-5d0d-431c-abe9-96834739aa27', 'volume_size': 1} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6" returned: 0 in 0.451s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-851072755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeacdca1-5d0d-431c-abe9-96834739aa27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf317dc4beb41c0b24913edf54cfdd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:15Z,use_quota=True,user_id='781620caa62240ef8f7f955bc380c3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Creating volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:28:15 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:15 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 1073741824 Sep 08 07:28:15 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7df5cd-f279-4c1a-b10b-5547c7130579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb368e9-6018-4cef-aa9d-003c7e141e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:15 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Volume volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 (859b979a-58f8-4c07-8414-07e6ffbeb2d6): created successfully Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb368e9-6018-4cef-aa9d-003c7e141e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Flow 'volume_create_manager' (f03bf8e1-9518-4233-b79d-88263cc8bf15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:15 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-cecbe8a9-25f8-40a9-8b10-35ff1c2d07d4 tempest-VolumeQuotasAdminTestJSON-715410457 None] Created volume successfully. Sep 08 07:28:16 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 1073741824" returned: 0 in 0.520s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:16 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 Sep 08 07:28:16 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:16 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27" returned: 0 in 0.339s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:28:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0dff97-6276-4005-b0d9-aa06e73e80c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeacdca1-5d0d-431c-abe9-96834739aa27', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede4a205-68c0-4c44-b69a-94d585d0902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Volume volume-aeacdca1-5d0d-431c-abe9-96834739aa27 (aeacdca1-5d0d-431c-abe9-96834739aa27): created successfully Sep 08 07:28:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede4a205-68c0-4c44-b69a-94d585d0902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Flow 'volume_create_manager' (8b454117-3117-49a5-9858-bf596e1e7bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:16 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-57397637-945f-4881-99cc-ed43944ae854 tempest-SnapshotsActionsTest-667719279 None] Created volume successfully. Sep 08 07:28:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0d2f5e09-276e-400f-8d78-43ddec397e1c tempest-VolumeQuotasAdminTestJSON-1435562540 None] Transfer volume completed successfully. Sep 08 07:28:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Creating offline snapshot 4428d12c-1db7-4ae2-a601-8b11cef41dd0 of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:28:17 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[987467db-411f-47fd-8960-b64029544705]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:18 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 Sep 08 07:28:18 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Acquiring lock "cinder-859b979a-58f8-4c07-8414-07e6ffbeb2d6-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Lock "cinder-859b979a-58f8-4c07-8414-07e6ffbeb2d6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Acquiring lock "cinder-quobyte-859b979a-58f8-4c07-8414-07e6ffbeb2d6" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Lock "cinder-quobyte-859b979a-58f8-4c07-8414-07e6ffbeb2d6" acquired by "delete_volume" :: waited 0.035s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf728fe-baf1-449e-bf8b-0ee8414c5443]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:18 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 Sep 08 07:28:18 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:18 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27" returned: 0 in 0.647s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:18 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 1G Sep 08 07:28:18 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:18 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6" returned: 0 in 0.511s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:18 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6 Sep 08 07:28:18 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:19 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 1G" returned: 0 in 0.552s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:19 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:19 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:19 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-859b979a-58f8-4c07-8414-07e6ffbeb2d6" returned: 0 in 0.339s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Lock "cinder-quobyte-859b979a-58f8-4c07-8414-07e6ffbeb2d6" released by "delete_volume" :: held 0.961s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Created reservations ['638f06d3-e883-4799-9bad-57b8038e39b9', '5a51523a-3ce3-427c-8bf1-93c8b04b269d', '6d1bcfa2-a697-4d38-b587-0672d251e2aa', '555f076e-52b0-45ee-aac9-97abb18bdfe4'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:19 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.397s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:19 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 is being set with open permissions: ugo+rw Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:19 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:19 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:19 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:19 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:19 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.335s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Deleted volume successfully. Sep 08 07:28:19 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.352s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c938979-6c11-4d9d-a113-44cecfd80175 tempest-VolumeQuotasAdminTestJSON-1279470176 None] Lock "cinder-859b979a-58f8-4c07-8414-07e6ffbeb2d6-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:19 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.info Sep 08 07:28:19 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:20 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.info" returned: 0 in 0.292s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:20 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.info is being set with open permissions: ugo+rw Sep 08 07:28:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:20 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.info Sep 08 07:28:20 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:20 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.info" returned: 0 in 0.418s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ce39f6db-869a-4b5e-9a7f-d2de2ab450dd tempest-SnapshotsActionsTest-667719279 None] Create snapshot completed successfully Sep 08 07:28:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Creating offline snapshot 40b8e014-67c7-4049-b484-8d68fb9870a9 of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:28:22 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8217da-78da-46bd-8fce-395ecac2114d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:22 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:22 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:23 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.637s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:23 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 1G Sep 08 07:28:23 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:24 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 1G" returned: 0 in 0.841s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:24 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 Sep 08 07:28:24 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:24 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9" returned: 0 in 0.466s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:24 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 is being set with open permissions: ugo+rw Sep 08 07:28:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:24 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 Sep 08 07:28:24 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:24 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9" returned: 0 in 0.387s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:25 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ecf2f076-ba94-40e3-bfaa-b4c6ece651c1 tempest-SnapshotsActionsTest-667719279 None] Create snapshot completed successfully Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-40b8e014-67c7-4049-b484-8d68fb9870a9-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-40b8e014-67c7-4049-b484-8d68fb9870a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-quobyte-40b8e014-67c7-4049-b484-8d68fb9870a9" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-40b8e014-67c7-4049-b484-8d68fb9870a9" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Deleting offline snapshot 40b8e014-67c7-4049-b484-8d68fb9870a9 of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] snapshot_file for this snap is: volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e70b0f-e028-4090-9588-97c46281d20f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:26 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 Sep 08 07:28:26 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:26 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9" returned: 0 in 0.556s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:26 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[48578e92-bbfd-491c-9475-f6d437bdfc73]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:26 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:26 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:27 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.613s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:27 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 Sep 08 07:28:27 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:27 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9" returned: 0 in 0.589s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:27 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9 Sep 08 07:28:27 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:28 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.40b8e014-67c7-4049-b484-8d68fb9870a9" returned: 0 in 0.296s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-40b8e014-67c7-4049-b484-8d68fb9870a9" released by "_delete_snapshot" :: held 2.196s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" released by "delete_snapshot" :: held 2.236s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:28 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Created reservations ['f8d60791-eb0f-41d6-b03c-317fd364882c', '42e7b796-dec6-4aa3-9c61-d94ff89d6dd2', 'f60c9ad2-bccb-42a0-92ee-8f88de7c3dbd', '09d08b80-c44e-4783-ae4a-711e7b88f661'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:28 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Delete snapshot completed successfully. Sep 08 07:28:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-80a86951-8a3f-4764-bf19-4167b4b29439 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-40b8e014-67c7-4049-b484-8d68fb9870a9-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Creating offline snapshot b041435c-5097-4f6e-9c4e-7290e6452975 of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:28:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56e786f-6692-4d97-ab46-6173ea3ec355]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:29 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:29 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:30 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.473s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:30 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 1G Sep 08 07:28:30 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:30 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 1G" returned: 0 in 0.531s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:30 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 Sep 08 07:28:30 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:31 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975" returned: 0 in 0.418s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:31 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 is being set with open permissions: ugo+rw Sep 08 07:28:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:31 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 Sep 08 07:28:31 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:31 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975" returned: 0 in 0.322s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4f6a4e87-680a-4c64-989a-795ba589883a tempest-SnapshotsActionsTest-667719279 None] Create snapshot completed successfully Sep 08 07:28:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-b041435c-5097-4f6e-9c4e-7290e6452975-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-b041435c-5097-4f6e-9c4e-7290e6452975-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-quobyte-b041435c-5097-4f6e-9c4e-7290e6452975" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-b041435c-5097-4f6e-9c4e-7290e6452975" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Deleting offline snapshot b041435c-5097-4f6e-9c4e-7290e6452975 of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] snapshot_file for this snap is: volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe88be6d-e10e-448a-9581-fdfd0c2a2203]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:32 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 Sep 08 07:28:32 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:32 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975" returned: 0 in 0.628s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[160dcd37-169f-4f7d-aebb-280cb6a37ac9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:33 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:33 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Flow 'volume_create_manager' (16f9c589-04e4-441f-8ffe-083d38c63970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2e190f-1f06-4fc3-ba52-c609397c667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2e190f-1f06-4fc3-ba52-c609397c667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-956538258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c9e270-5569-4715-87d6-4e23b9ecd03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9268fa139a4e1686f5fc0a434b09d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:33Z,use_quota=True,user_id='ed250598913c4f0997dfcb89f8fc0df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bfa92a-eb22-4a18-b28e-823d81cae48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:33 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bfa92a-eb22-4a18-b28e-823d81cae48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01da294d-a0eb-450e-be45-974d2ff9ac5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01da294d-a0eb-450e-be45-974d2ff9ac5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c9e270-5569-4715-87d6-4e23b9ecd03b', 'volume_name': 'volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247537fb-b67c-4339-a0f2-c50d864d6897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247537fb-b67c-4339-a0f2-c50d864d6897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebdba1b3-8687-4620-bffc-58aef1d73028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:33 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Volume d8c9e270-5569-4715-87d6-4e23b9ecd03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b', 'volume_size': 1} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-956538258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c9e270-5569-4715-87d6-4e23b9ecd03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9268fa139a4e1686f5fc0a434b09d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:33Z,use_quota=True,user_id='ed250598913c4f0997dfcb89f8fc0df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Creating volume d8c9e270-5569-4715-87d6-4e23b9ecd03b {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:28:33 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.729s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:33 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b 1073741824 Sep 08 07:28:33 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:33 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 Sep 08 07:28:33 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:33 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975" returned: 0 in 0.472s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:34 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b 1073741824" returned: 0 in 0.502s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:34 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975 Sep 08 07:28:34 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:34 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b Sep 08 07:28:34 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:34 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b" returned: 0 in 0.326s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:34 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.b041435c-5097-4f6e-9c4e-7290e6452975" returned: 0 in 0.403s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebdba1b3-8687-4620-bffc-58aef1d73028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170b7f3d-0415-4279-9eed-287c6d0716ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-b041435c-5097-4f6e-9c4e-7290e6452975" released by "_delete_snapshot" :: held 2.395s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" released by "delete_snapshot" :: held 2.443s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:34 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Volume volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b (d8c9e270-5569-4715-87d6-4e23b9ecd03b): created successfully Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170b7f3d-0415-4279-9eed-287c6d0716ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Flow 'volume_create_manager' (16f9c589-04e4-441f-8ffe-083d38c63970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:34 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bc611788-5634-4a95-b47d-28592194c59d tempest-VolumesServicesTestJSON-1419949137 None] Created volume successfully. Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Created reservations ['bd25b565-14cb-4e93-be69-4cef3b5b29e3', 'dea9f376-e200-49ef-bf0e-83808b2dd9c1', 'da89101c-c635-4c01-a573-49efae68f329', 'f486e053-44a0-4bcb-b50b-a845e56d3b60'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:34 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Delete snapshot completed successfully. Sep 08 07:28:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9c4c8d65-b01f-4d06-bab9-faac9238b3b5 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-b041435c-5097-4f6e-9c4e-7290e6452975-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Creating offline snapshot 43a7aeca-9d2e-41b7-b781-b7705b472a12 of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6481b2a3-4396-4b65-8180-36f7f3aac7fa]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Acquiring lock "cinder-d8c9e270-5569-4715-87d6-4e23b9ecd03b-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Lock "cinder-d8c9e270-5569-4715-87d6-4e23b9ecd03b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:35 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:35 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Acquiring lock "cinder-quobyte-d8c9e270-5569-4715-87d6-4e23b9ecd03b" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Lock "cinder-quobyte-d8c9e270-5569-4715-87d6-4e23b9ecd03b" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0881c47-0893-45a1-a1ef-accfc2a6b906]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:35 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b Sep 08 07:28:35 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:36 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.412s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:36 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 1G Sep 08 07:28:36 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:36 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b" returned: 0 in 0.378s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:36 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b Sep 08 07:28:36 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:36 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d8c9e270-5569-4715-87d6-4e23b9ecd03b" returned: 0 in 0.257s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Lock "cinder-quobyte-d8c9e270-5569-4715-87d6-4e23b9ecd03b" released by "delete_volume" :: held 0.683s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Created reservations ['c51b393a-31d5-436a-a4b7-bf1d70961fe5', '8a245877-50b6-40c1-8266-609f73b116af', 'fdc9b449-6037-4cc0-9ba5-664dac0e157b', '5667d83e-8e3e-4bfb-ac3e-9c69d3c77beb'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:36 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 1G" returned: 0 in 0.541s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:36 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 Sep 08 07:28:36 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:36 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:36 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:36 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.271s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:36 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Deleted volume successfully. Sep 08 07:28:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-63b54a09-c3c3-4e28-b287-4ff830c3d6ce tempest-VolumesServicesTestJSON-1419949137 None] Lock "cinder-d8c9e270-5569-4715-87d6-4e23b9ecd03b-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:36 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12" returned: 0 in 0.419s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:37 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 is being set with open permissions: ugo+rw Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:37 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 Sep 08 07:28:37 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Flow 'volume_create_manager' (8385a0b7-a764-4417-966a-bcb4cd95a14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2905efc2-c260-44fe-b8a8-eda2944b1f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2905efc2-c260-44fe-b8a8-eda2944b1f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1216418950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec34bf3-7480-48f0-94e8-d2ab3d514cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5454e118c3f74a6caccd8ea82f9458a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:37Z,use_quota=True,user_id='8150e9bb583b4d06bdf2a5ed18662921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54222b39-2c37-40f9-912a-f499a18b48df),volume_type_id=54222b39-2c37-40f9-912a-f499a18b48df)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e6d6c8-83a1-432e-b9f4-24fd2b556d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e6d6c8-83a1-432e-b9f4-24fd2b556d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec010261-9a8c-45c8-8f0a-865c186e8989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec010261-9a8c-45c8-8f0a-865c186e8989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec34bf3-7480-48f0-94e8-d2ab3d514cfb', 'volume_name': 'volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaf2370-a6a9-4159-ada2-328b71dc4e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:37 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaf2370-a6a9-4159-ada2-328b71dc4e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cf3188-99b6-4442-90f6-7ea9e7ee653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:37 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Volume 8ec34bf3-7480-48f0-94e8-d2ab3d514cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb', 'volume_size': 1} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12" returned: 0 in 0.296s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.782s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1216418950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec34bf3-7480-48f0-94e8-d2ab3d514cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5454e118c3f74a6caccd8ea82f9458a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:37Z,use_quota=True,user_id='8150e9bb583b4d06bdf2a5ed18662921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54222b39-2c37-40f9-912a-f499a18b48df),volume_type_id=54222b39-2c37-40f9-912a-f499a18b48df)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Creating volume 8ec34bf3-7480-48f0-94e8-d2ab3d514cfb {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:28:37 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:37 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb 1073741824 Sep 08 07:28:37 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-65c2fe01-76d0-41ee-a5b8-0e718ef1427b tempest-SnapshotsActionsTest-667719279 None] Create snapshot completed successfully Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-43a7aeca-9d2e-41b7-b781-b7705b472a12-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-43a7aeca-9d2e-41b7-b781-b7705b472a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-quobyte-43a7aeca-9d2e-41b7-b781-b7705b472a12" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-43a7aeca-9d2e-41b7-b781-b7705b472a12" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Deleting offline snapshot 43a7aeca-9d2e-41b7-b781-b7705b472a12 of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] snapshot_file for this snap is: volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:28:37 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[510ec270-ecd1-4951-b475-b63732fbb2ac]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb 1073741824" returned: 0 in 0.531s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:37 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb Sep 08 07:28:37 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:37 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 Sep 08 07:28:37 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:38 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb" returned: 0 in 0.289s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cf3188-99b6-4442-90f6-7ea9e7ee653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b00932a-8c6d-458c-b125-ff0979ad33d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:38 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12" returned: 0 in 0.371s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:38 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Volume volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb (8ec34bf3-7480-48f0-94e8-d2ab3d514cfb): created successfully Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b00932a-8c6d-458c-b125-ff0979ad33d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Flow 'volume_create_manager' (8385a0b7-a764-4417-966a-bcb4cd95a14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd8e70-8998-4318-8fdf-aa0d10bfeb06]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-45b3e5cf-8055-43ad-aca4-4126bd94d81a tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Created volume successfully. Sep 08 07:28:38 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:38 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:38 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.387s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:38 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 Sep 08 07:28:38 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:39 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12" returned: 0 in 0.395s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:39 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12 Sep 08 07:28:39 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:39 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.43a7aeca-9d2e-41b7-b781-b7705b472a12" returned: 0 in 0.279s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-43a7aeca-9d2e-41b7-b781-b7705b472a12" released by "_delete_snapshot" :: held 1.569s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" released by "delete_snapshot" :: held 1.594s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Created reservations ['80ce430f-c543-4029-bd92-91ae090c8302', '98ce9a56-58b8-4a72-8c29-34e2b1a76a2f', '2dd84105-66d6-4442-bf46-d340c5840924', '345b90d8-30da-4167-b384-96e4c34945d5'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:39 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Delete snapshot completed successfully. Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b118128d-c160-4863-bf96-67faeef5cd34 tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-43a7aeca-9d2e-41b7-b781-b7705b472a12-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4fe17ceb-fa12-47e4-8515-b03815db56d2 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4fe17ceb-fa12-47e4-8515-b03815db56d2 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4fe17ceb-fa12-47e4-8515-b03815db56d2 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4fe17ceb-fa12-47e4-8515-b03815db56d2 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4fe17ceb-fa12-47e4-8515-b03815db56d2 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4fe17ceb-fa12-47e4-8515-b03815db56d2 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:39 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:39 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:39 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4fe17ceb-fa12-47e4-8515-b03815db56d2 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.276s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4fe17ceb-fa12-47e4-8515-b03815db56d2 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4fe17ceb-fa12-47e4-8515-b03815db56d2 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Retype volume completed successfully. Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Creating offline snapshot 765783f3-89b8-4169-90de-d2a9dac25b7f of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e238f6f8-c245-4c96-9c03-0d0056fc147b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:40 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:40 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:40 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.382s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:40 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f 1G Sep 08 07:28:40 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Acquiring lock "cinder-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "cinder-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Acquiring lock "cinder-quobyte-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "cinder-quobyte-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df9b11d-511f-4aba-80d0-cdbf39b168b9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:41 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f 1G" returned: 0 in 0.518s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:41 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb Sep 08 07:28:41 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:41 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f Sep 08 07:28:41 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:41 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb" returned: 0 in 0.416s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:41 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb Sep 08 07:28:41 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:41 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f" returned: 0 in 0.371s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:41 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f is being set with open permissions: ugo+rw Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:41 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f Sep 08 07:28:41 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:41 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb" returned: 0 in 0.326s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:41 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f" returned: 0 in 0.288s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "cinder-quobyte-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb" released by "delete_volume" :: held 0.789s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.674s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:41 devstack cinder-volume[87278]: WARNING cinder.quota [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:28:41 devstack cinder-volume[87278]: WARNING cinder.quota [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:28:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-dfe77f26-2623-4a20-b17e-b007f36e1dab tempest-SnapshotsActionsTest-667719279 None] Create snapshot completed successfully Sep 08 07:28:41 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Created reservations ['9eee4925-3c76-440a-9382-8e26e036d4ec', '7c0666d6-6289-4414-ab88-ba9c80120768', '0d503bfb-c788-4a53-a7c8-d8b0c326d45a', '007e6c05-82ee-4bec-bfef-789a684c49e4'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:42 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:42 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:42 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-765783f3-89b8-4169-90de-d2a9dac25b7f-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.519s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Deleted volume successfully. Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-765783f3-89b8-4169-90de-d2a9dac25b7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Acquiring lock "cinder-quobyte-765783f3-89b8-4169-90de-d2a9dac25b7f" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8e784df9-b9a7-4464-a3d1-91820593c062 tempest-VolumeRetypeWithoutMigrationTest-1597279776 None] Lock "cinder-8ec34bf3-7480-48f0-94e8-d2ab3d514cfb-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-765783f3-89b8-4169-90de-d2a9dac25b7f" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Deleting offline snapshot 765783f3-89b8-4169-90de-d2a9dac25b7f of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] snapshot_file for this snap is: volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaa7e33-9da3-4c2a-873d-dcdfaab639b6]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:42 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f Sep 08 07:28:42 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:43 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f" returned: 0 in 0.452s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:43 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[75198bad-0824-4702-8c44-f74531ce12de]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:43 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:43 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:43 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.442s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:43 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f Sep 08 07:28:43 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:44 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f" returned: 0 in 0.426s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:44 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f Sep 08 07:28:44 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:44 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.765783f3-89b8-4169-90de-d2a9dac25b7f" returned: 0 in 0.290s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-765783f3-89b8-4169-90de-d2a9dac25b7f" released by "_delete_snapshot" :: held 1.752s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" released by "delete_snapshot" :: held 1.801s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Created reservations ['84cc9ac1-9bef-470c-8303-52f4ead3e482', '12c751f6-096b-4bfa-97eb-80e2cea7027d', '0b1b903b-954d-4c5b-a2ae-16675f4f6376', 'f1404e23-4d91-46a8-a139-079c9d793996'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:44 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Delete snapshot completed successfully. Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-325e911e-ea37-4d52-a8ae-77990411dc8a tempest-SnapshotsActionsTest-472860288 None] Lock "cinder-765783f3-89b8-4169-90de-d2a9dac25b7f-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:44 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:44 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:44 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.305s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:28:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "cinder-4428d12c-1db7-4ae2-a601-8b11cef41dd0-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-4428d12c-1db7-4ae2-a601-8b11cef41dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "cinder-quobyte-4428d12c-1db7-4ae2-a601-8b11cef41dd0" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-quobyte-4428d12c-1db7-4ae2-a601-8b11cef41dd0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Deleting offline snapshot 4428d12c-1db7-4ae2-a601-8b11cef41dd0 of volume aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] snapshot_file for this snap is: volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce4a370-3860-438b-81a1-eb5f0b033a56]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:45 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:45 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:45 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.457s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeacdca1-5d0d-431c-abe9-96834739aa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e38691-2009-4c1a-b7f1-257069bbf9f9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:46 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 Sep 08 07:28:46 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:46 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27" returned: 0 in 0.456s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:46 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:46 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:46 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.450s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:46 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0 Sep 08 07:28:46 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:28:47 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Flow 'volume_create_manager' (f5e31d54-7a06-48d0-83e4-8753cbd5421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1e2351-7685-418a-9d54-537201e1eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27.4428d12c-1db7-4ae2-a601-8b11cef41dd0" returned: 0 in 0.434s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1e2351-7685-418a-9d54-537201e1eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1319315570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b42529-319b-4ab8-abcd-c3f343db7dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48fd3824518a4bdda945fa6c227a8f5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:47Z,use_quota=True,user_id='5c707a73a05044baabb009620b27de5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c276bde4-e252-4e11-9b38-a9830b39e242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c276bde4-e252-4e11-9b38-a9830b39e242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdbc9a1-df93-4185-ba4c-7997a1667de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdbc9a1-df93-4185-ba4c-7997a1667de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b42529-319b-4ab8-abcd-c3f343db7dbf', 'volume_name': 'volume-48b42529-319b-4ab8-abcd-c3f343db7dbf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0837c5fa-6b89-4318-8fc4-b62ade7acb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0837c5fa-6b89-4318-8fc4-b62ade7acb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ddf1f5-5ad0-4f0e-b257-46dedb3afa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:47 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Volume 48b42529-319b-4ab8-abcd-c3f343db7dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b42529-319b-4ab8-abcd-c3f343db7dbf', 'volume_size': 1} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1319315570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b42529-319b-4ab8-abcd-c3f343db7dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48fd3824518a4bdda945fa6c227a8f5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:47Z,use_quota=True,user_id='5c707a73a05044baabb009620b27de5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Creating volume 48b42529-319b-4ab8-abcd-c3f343db7dbf {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:28:47 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:47 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf 1073741824 Sep 08 07:28:47 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-quobyte-4428d12c-1db7-4ae2-a601-8b11cef41dd0" released by "_delete_snapshot" :: held 2.058s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" released by "delete_snapshot" :: held 2.089s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Created reservations ['85fd4ac9-b73b-4dd9-85d1-3e251b1d861f', '50515cee-76c5-4639-a7c5-f111eb5ce263', '8ce3ffa1-e520-4d1b-9904-b912c8fcb5bf', '6376880e-9b52-45f6-8045-1c92ee76032d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Delete snapshot completed successfully. Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cc405ad1-decb-44cb-a605-cc06d43ac167 tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-4428d12c-1db7-4ae2-a601-8b11cef41dd0-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:47 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf 1073741824" returned: 0 in 0.505s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:47 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf Sep 08 07:28:47 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:48 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf" returned: 0 in 0.277s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ddf1f5-5ad0-4f0e-b257-46dedb3afa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b42529-319b-4ab8-abcd-c3f343db7dbf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20d85a7-d9d4-496a-8885-e5dee8195986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:48 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Volume volume-48b42529-319b-4ab8-abcd-c3f343db7dbf (48b42529-319b-4ab8-abcd-c3f343db7dbf): created successfully Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20d85a7-d9d4-496a-8885-e5dee8195986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Flow 'volume_create_manager' (f5e31d54-7a06-48d0-83e4-8753cbd5421d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:48 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-21394f21-3ab6-4f82-bc6a-7e00afb6d16c tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Created volume successfully. Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "cinder-aeacdca1-5d0d-431c-abe9-96834739aa27-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-aeacdca1-5d0d-431c-abe9-96834739aa27-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5714b43a-7d7a-43f4-9c10-38e537a34d3e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:48 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 Sep 08 07:28:48 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:49 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27" returned: 0 in 0.390s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:49 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27 Sep 08 07:28:49 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:49 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aeacdca1-5d0d-431c-abe9-96834739aa27" returned: 0 in 0.289s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-quobyte-aeacdca1-5d0d-431c-abe9-96834739aa27" released by "delete_volume" :: held 0.745s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Created reservations ['268e28ff-bc55-4df6-b3f5-abbf99680422', '18369c5b-3540-491a-be0d-efb25f1eb5e3', '6b3acbd9-e4f8-48a4-b5c6-20cd971fe99b', '45fc6510-9184-4a04-81b0-72c143a7d701'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:49 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:49 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:49 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.324s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:50 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:50 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Deleted volume successfully. Sep 08 07:28:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea0bea93-ad65-4d03-b8ff-aef249ec05ff tempest-SnapshotsActionsTest-667719279 None] Lock "cinder-aeacdca1-5d0d-431c-abe9-96834739aa27-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-78bb5245-f2f1-4f95-97d6-015de15f9e49 req-4a679439-e64e-4b3a-a4e4-f492205ba2be tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-78bb5245-f2f1-4f95-97d6-015de15f9e49 req-4a679439-e64e-4b3a-a4e4-f492205ba2be tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-78bb5245-f2f1-4f95-97d6-015de15f9e49 req-4a679439-e64e-4b3a-a4e4-f492205ba2be tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-78bb5245-f2f1-4f95-97d6-015de15f9e49 req-4a679439-e64e-4b3a-a4e4-f492205ba2be tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-48b42529-319b-4ab8-abcd-c3f343db7dbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21d4610c-3b78-4e36-95ab-9c8f4b6436d8', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:28:50 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-78bb5245-f2f1-4f95-97d6-015de15f9e49 req-4a679439-e64e-4b3a-a4e4-f492205ba2be tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] attachment_update completed successfully. Sep 08 07:28:54 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-e83ca237-c9f9-4193-a177-22077c56842e req-2d0eb0c2-7a5c-4917-9ce7-73170d4afa77 tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Terminate volume connection completed successfully. Sep 08 07:28:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-e83ca237-c9f9-4193-a177-22077c56842e req-2d0eb0c2-7a5c-4917-9ce7-73170d4afa77 tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Deleting attachment 21d4610c-3b78-4e36-95ab-9c8f4b6436d8. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:28:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Acquiring lock "cinder-48b42529-319b-4ab8-abcd-c3f343db7dbf-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "cinder-48b42529-319b-4ab8-abcd-c3f343db7dbf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Acquiring lock "cinder-quobyte-48b42529-319b-4ab8-abcd-c3f343db7dbf" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:28:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "cinder-quobyte-48b42529-319b-4ab8-abcd-c3f343db7dbf" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:28:55 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[618e1e18-210b-4fde-9cdc-699a5223b372]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:28:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:55 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf Sep 08 07:28:55 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:55 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf" returned: 0 in 0.402s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:55 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf Sep 08 07:28:55 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:56 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-48b42529-319b-4ab8-abcd-c3f343db7dbf" returned: 0 in 0.283s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "cinder-quobyte-48b42529-319b-4ab8-abcd-c3f343db7dbf" released by "delete_volume" :: held 0.729s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Created reservations ['a681acf0-38e4-4f61-bda7-84b45ef96b54', '95b45a2d-1d3a-4d3c-b70a-934ac18479ca', '553b3fc5-e017-49b2-b72d-f827997480a1', '9d963c91-1643-4d69-88ba-d642f878acf2'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:56 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:28:56 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:28:56 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.344s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:28:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Deleted volume successfully. Sep 08 07:28:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ecb6acd9-5fa3-475c-982f-38927b5cb9db tempest-TestServerVolumeAttachScenarioOldVersion-1498131083 None] Lock "cinder-48b42529-319b-4ab8-abcd-c3f343db7dbf-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Flow 'volume_create_manager' (25e3e647-0025-466c-ab98-559eff55f249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947a64aa-d552-4765-8be5-1494d87e7582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=140,cinder:SELECT=107,cinder:INSERT=32,cinder:DELETE=12 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947a64aa-d552-4765-8be5-1494d87e7582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-570220590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d32a1f3-f243-4eb5-91d9-7cc5e9240cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edce18c1d48c4467978d3e3eb392fefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:59Z,use_quota=True,user_id='eae1df762a984f5999c8d051d84d3588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcddc14d-50bc-4ccf-8e1d-370a6ee0892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcddc14d-50bc-4ccf-8e1d-370a6ee0892e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe873732-e0d8-4e2e-a7c0-cafbb8ca99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe873732-e0d8-4e2e-a7c0-cafbb8ca99f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d32a1f3-f243-4eb5-91d9-7cc5e9240cea', 'volume_name': 'volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02305baf-b4e2-475b-a508-d077539813f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02305baf-b4e2-475b-a508-d077539813f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34485c8-7ad7-4766-8fa6-705bdb576ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:28:59 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Volume 1d32a1f3-f243-4eb5-91d9-7cc5e9240cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea', 'volume_size': 1} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-570220590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d32a1f3-f243-4eb5-91d9-7cc5e9240cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edce18c1d48c4467978d3e3eb392fefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:28:59Z,use_quota=True,user_id='eae1df762a984f5999c8d051d84d3588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Creating volume 1d32a1f3-f243-4eb5-91d9-7cc5e9240cea {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:28:59 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:28:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:28:59 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea 1073741824 Sep 08 07:28:59 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:00 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea 1073741824" returned: 0 in 0.722s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:00 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea Sep 08 07:29:00 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Flow 'volume_create_manager' (0586fc5a-af1e-4d03-9b1e-f8f1b76c0512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02393235-0432-45c9-9f0d-366432a3e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02393235-0432-45c9-9f0d-366432a3e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-684568857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b48ccc-9ca1-4930-b888-44c00dc94c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1905d8a8344e497b8e0e814139413e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:00Z,use_quota=True,user_id='90d918f7583c42928ce3cce251ba83f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd2020e-b9d0-4852-b916-0eb1a3d351a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd2020e-b9d0-4852-b916-0eb1a3d351a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f879251c-6c01-442b-b67c-bdfa72f26285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f879251c-6c01-442b-b67c-bdfa72f26285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b48ccc-9ca1-4930-b888-44c00dc94c91', 'volume_name': 'volume-64b48ccc-9ca1-4930-b888-44c00dc94c91', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f282cf81-8d9e-4399-bd09-ba666fc8551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f282cf81-8d9e-4399-bd09-ba666fc8551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e507ea-2f24-43cb-9531-a2ac5094e06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:00 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Volume 64b48ccc-9ca1-4930-b888-44c00dc94c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b48ccc-9ca1-4930-b888-44c00dc94c91', 'volume_size': 1} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:00 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" returned: 0 in 0.354s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.103s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-684568857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b48ccc-9ca1-4930-b888-44c00dc94c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1905d8a8344e497b8e0e814139413e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:00Z,use_quota=True,user_id='90d918f7583c42928ce3cce251ba83f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Creating volume 64b48ccc-9ca1-4930-b888-44c00dc94c91 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:29:00 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34485c8-7ad7-4766-8fa6-705bdb576ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3abfed-c9e1-4138-b644-332a6bc70026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:00 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 1073741824 Sep 08 07:29:00 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:00 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Volume volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea (1d32a1f3-f243-4eb5-91d9-7cc5e9240cea): created successfully Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3abfed-c9e1-4138-b644-332a6bc70026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Flow 'volume_create_manager' (25e3e647-0025-466c-ab98-559eff55f249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:00 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-af6d7ca2-dda2-4f84-a1a9-d26821b84a28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Created volume successfully. Sep 08 07:29:01 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 1073741824" returned: 0 in 0.497s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:01 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 Sep 08 07:29:01 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:01 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91" returned: 0 in 0.332s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e507ea-2f24-43cb-9531-a2ac5094e06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b48ccc-9ca1-4930-b888-44c00dc94c91', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865baf33-9ed0-4cdf-969f-61aa30867667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:01 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Volume volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 (64b48ccc-9ca1-4930-b888-44c00dc94c91): created successfully Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865baf33-9ed0-4cdf-969f-61aa30867667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Flow 'volume_create_manager' (0586fc5a-af1e-4d03-9b1e-f8f1b76c0512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0054ab23-bd6e-4ff5-9901-271149831a4f tempest-AbsoluteLimitsTests-1390136363 None] Created volume successfully. Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Creating offline snapshot 4382d1ae-894c-4b52-b553-dadc209f007f of volume 1d32a1f3-f243-4eb5-91d9-7cc5e9240cea {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddf0e0b-5b4d-4e12-af21-b0cd3ed697b7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:01 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea Sep 08 07:29:01 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:02 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" returned: 0 in 0.407s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:02 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f 1G Sep 08 07:29:02 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Acquiring lock "cinder-64b48ccc-9ca1-4930-b888-44c00dc94c91-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Lock "cinder-64b48ccc-9ca1-4930-b888-44c00dc94c91-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:02 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f 1G" returned: 0 in 0.699s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Acquiring lock "cinder-quobyte-64b48ccc-9ca1-4930-b888-44c00dc94c91" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Lock "cinder-quobyte-64b48ccc-9ca1-4930-b888-44c00dc94c91" acquired by "delete_volume" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:03 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f Sep 08 07:29:03 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[302022c3-7879-47c5-ac5c-93698f46a739]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:03 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 Sep 08 07:29:03 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:03 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f" returned: 0 in 0.368s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:03 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f is being set with open permissions: ugo+rw Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:03 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f Sep 08 07:29:03 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:03 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91" returned: 0 in 0.454s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:03 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91 Sep 08 07:29:03 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:03 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f" returned: 0 in 0.322s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=117,cinder:UPDATE=119,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:03 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.info Sep 08 07:29:03 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:03 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-64b48ccc-9ca1-4930-b888-44c00dc94c91" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Lock "cinder-quobyte-64b48ccc-9ca1-4930-b888-44c00dc94c91" released by "delete_volume" :: held 0.840s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:03 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Created reservations ['5b90a66c-03c2-4105-847e-7b44e81825b5', '2d8c9615-2e0a-49e0-a074-754795ac8b65', 'c304f70c-95e6-47ab-a12a-02b06fdcf7a4', 'fa08e646-ce4c-4c19-912f-2bd73dab818c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:04 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.info" returned: 0 in 0.344s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:04 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.info is being set with open permissions: ugo+rw Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:04 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.info Sep 08 07:29:04 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:04 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:29:04 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:04 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.info" returned: 0 in 0.428s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.688s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:04 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:29:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Deleted volume successfully. Sep 08 07:29:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-af430354-4767-40c1-acad-9bcfa251d651 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Create snapshot completed successfully Sep 08 07:29:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0517956f-3017-4a99-aa96-b537c28a610f tempest-AbsoluteLimitsTests-1390136363 None] Lock "cinder-64b48ccc-9ca1-4930-b888-44c00dc94c91-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Acquiring lock "cinder-4382d1ae-894c-4b52-b553-dadc209f007f-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-4382d1ae-894c-4b52-b553-dadc209f007f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Acquiring lock "cinder-quobyte-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-quobyte-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Acquiring lock "cinder-quobyte-4382d1ae-894c-4b52-b553-dadc209f007f" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-quobyte-4382d1ae-894c-4b52-b553-dadc209f007f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Deleting offline snapshot 4382d1ae-894c-4b52-b553-dadc209f007f of volume 1d32a1f3-f243-4eb5-91d9-7cc5e9240cea {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] snapshot_file for this snap is: volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe329e87-57d6-4960-801a-a312fe2bbe39]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:05 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f Sep 08 07:29:05 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:06 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f" returned: 0 in 0.378s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:29:06 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b97af9-83ac-4069-a33b-ef7136239899]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:06 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea Sep 08 07:29:06 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:06 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" returned: 0 in 0.450s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:06 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f Sep 08 07:29:06 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:07 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f" returned: 0 in 0.442s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:07 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f Sep 08 07:29:07 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:07 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea.4382d1ae-894c-4b52-b553-dadc209f007f" returned: 0 in 0.312s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:07 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-quobyte-4382d1ae-894c-4b52-b553-dadc209f007f" released by "_delete_snapshot" :: held 1.736s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:07 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-quobyte-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" released by "delete_snapshot" :: held 1.761s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:07 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Created reservations ['90f33687-7244-4b42-a76e-bed7cee28544', '84c7ab2e-ef55-4b44-9c4d-53cd01e0d75d', '97b8f417-c061-4079-9963-a0e261f34de6', '5dfb8155-ce93-4075-8cf9-4b2c0ef06790'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:07 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Delete snapshot completed successfully. Sep 08 07:29:07 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90807c6a-ea04-4c0e-a0a6-866390ac6c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-4382d1ae-894c-4b52-b553-dadc209f007f-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Acquiring lock "cinder-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Acquiring lock "cinder-quobyte-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:08 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-quobyte-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" acquired by "delete_volume" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:08 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d89b4a-0f39-40e8-9a53-a30514915254]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:08 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea Sep 08 07:29:08 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:08 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" returned: 0 in 0.502s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:08 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea Sep 08 07:29:08 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:09 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" returned: 0 in 0.273s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-quobyte-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea" released by "delete_volume" :: held 0.866s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Created reservations ['4f144379-5440-416c-8bf6-67cc4f44567d', '01715769-d285-40a5-ae35-3ddfc6fbd6bb', 'f7fd4b3a-b53b-4551-8275-b3084bc3d807', '5948e201-97b4-4423-8d7f-02f28a1f2f97'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:09 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:29:09 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:09 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.321s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:29:09 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Deleted volume successfully. Sep 08 07:29:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b81a54a8-bef6-4b66-ba8e-bd8f9e098426 tempest-VolumeSnapshotQuotasNegativeTestJSON-1590095498 None] Lock "cinder-1d32a1f3-f243-4eb5-91d9-7cc5e9240cea-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Flow 'volume_create_manager' (430e930a-5d1e-4a14-8b03-e5a3fbb515f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddcd7c2-b57d-4346-8f8e-4eb91aabf557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddcd7c2-b57d-4346-8f8e-4eb91aabf557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1804148564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c042f8cb-d76c-4195-b7ea-efb2649a71e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ffa19e0fe8425597228c7f4b3b1c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:14Z,use_quota=True,user_id='c7d4bba621ea492080a4ca842cd1926e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f090a0df-8a36-4c8b-957b-a3f2467961c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f090a0df-8a36-4c8b-957b-a3f2467961c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e582f964-0513-4008-9896-4d46eb5aa4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e582f964-0513-4008-9896-4d46eb5aa4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c042f8cb-d76c-4195-b7ea-efb2649a71e6', 'volume_name': 'volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa46b57f-8244-484c-bdb5-10c60ae1ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa46b57f-8244-484c-bdb5-10c60ae1ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db48aac-8404-47e8-a5a8-7b43e800f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Volume c042f8cb-d76c-4195-b7ea-efb2649a71e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6', 'volume_size': 1} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1804148564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c042f8cb-d76c-4195-b7ea-efb2649a71e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ffa19e0fe8425597228c7f4b3b1c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:14Z,use_quota=True,user_id='c7d4bba621ea492080a4ca842cd1926e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Creating volume c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:29:14 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:14 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 1073741824 Sep 08 07:29:14 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:14 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 1073741824" returned: 0 in 0.572s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:15 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 Sep 08 07:29:15 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:15 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6" returned: 0 in 0.345s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:29:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db48aac-8404-47e8-a5a8-7b43e800f49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eff0806-a71f-429c-8139-e05618a589f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:15 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Volume volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 (c042f8cb-d76c-4195-b7ea-efb2649a71e6): created successfully Sep 08 07:29:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eff0806-a71f-429c-8139-e05618a589f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Flow 'volume_create_manager' (430e930a-5d1e-4a14-8b03-e5a3fbb515f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:15 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6ac12f88-4b80-4f83-8502-56e6ab0f3eb0 tempest-VolumesDeleteCascade-1346707237 None] Created volume successfully. Sep 08 07:29:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Creating offline snapshot 15704598-45da-4177-8365-6e0f878a720b of volume c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:29:16 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586d91f-c577-4508-8ada-3cddd65b84d5]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:17 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 Sep 08 07:29:17 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:17 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6" returned: 0 in 0.496s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:17 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b 1G Sep 08 07:29:17 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:18 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b 1G" returned: 0 in 0.696s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:18 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b Sep 08 07:29:18 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:18 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b" returned: 0 in 0.497s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:18 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b is being set with open permissions: ugo+rw Sep 08 07:29:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:18 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b Sep 08 07:29:18 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:18 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b" returned: 0 in 0.349s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:18 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.info Sep 08 07:29:18 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:19 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.info" returned: 0 in 0.336s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:19 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.info is being set with open permissions: ugo+rw Sep 08 07:29:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:19 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.info Sep 08 07:29:19 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:19 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.info" returned: 0 in 0.326s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.848s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-83539e39-a2dd-4127-94b4-c5039d33c5ea tempest-VolumesDeleteCascade-1346707237 None] Create snapshot completed successfully Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Flow 'volume_create_manager' (31a40b87-fac5-4c06-b2d4-b01026ffb26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7190fb0a-01a8-4361-a9eb-9f2383d630a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7190fb0a-01a8-4361-a9eb-9f2383d630a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-154385468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10a7b82-549a-474f-a64a-9c69066204b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a76eeb71c94a0bba9c58463211553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:20Z,use_quota=True,user_id='00888b9d0d4a4d14a671b593182a293f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9d66022-8867-4601-957f-29e707e7eda5),volume_type_id=c9d66022-8867-4601-957f-29e707e7eda5)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854a557d-6f0f-474e-b259-caa02fc85647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854a557d-6f0f-474e-b259-caa02fc85647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b0f233-27a8-4857-8f4e-7ac8dd2b5e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b0f233-27a8-4857-8f4e-7ac8dd2b5e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c10a7b82-549a-474f-a64a-9c69066204b2', 'volume_name': 'volume-c10a7b82-549a-474f-a64a-9c69066204b2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a338755-d48b-452d-9c48-b8770e9ef781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a338755-d48b-452d-9c48-b8770e9ef781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc60945e-d96d-4202-9cd4-ce901af5ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:20 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Volume c10a7b82-549a-474f-a64a-9c69066204b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c10a7b82-549a-474f-a64a-9c69066204b2', 'volume_size': 1} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-154385468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10a7b82-549a-474f-a64a-9c69066204b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a76eeb71c94a0bba9c58463211553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:20Z,use_quota=True,user_id='00888b9d0d4a4d14a671b593182a293f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9d66022-8867-4601-957f-29e707e7eda5),volume_type_id=c9d66022-8867-4601-957f-29e707e7eda5)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Creating volume c10a7b82-549a-474f-a64a-9c69066204b2 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:29:20 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:20 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2 1073741824 Sep 08 07:29:20 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:20 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2 1073741824" returned: 0 in 0.526s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:20 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2 Sep 08 07:29:21 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:21 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2" returned: 0 in 0.276s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.816s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc60945e-d96d-4202-9cd4-ce901af5ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10a7b82-549a-474f-a64a-9c69066204b2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b51de47-e51f-4df7-bdc8-9054650b6863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Creating offline snapshot c0b0add5-1fc5-49a1-b6d2-bb42b9603658 of volume c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:29:21 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Volume volume-c10a7b82-549a-474f-a64a-9c69066204b2 (c10a7b82-549a-474f-a64a-9c69066204b2): created successfully Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b51de47-e51f-4df7-bdc8-9054650b6863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Flow 'volume_create_manager' (31a40b87-fac5-4c06-b2d4-b01026ffb26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d718eb59-0120-4d0f-b357-a19db5364828]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:21 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2a191125-bd6b-4db4-b24e-2d87b3e4bbea tempest-VolumeTypesAccessTest-321395011 None] Created volume successfully. Sep 08 07:29:21 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b Sep 08 07:29:21 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:21 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b" returned: 0 in 0.460s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:29:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:21 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 1G Sep 08 07:29:21 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Acquiring lock "cinder-c10a7b82-549a-474f-a64a-9c69066204b2-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:22 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 1G" returned: 0 in 0.631s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Lock "cinder-c10a7b82-549a-474f-a64a-9c69066204b2-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:22 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 Sep 08 07:29:22 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Acquiring lock "cinder-quobyte-c10a7b82-549a-474f-a64a-9c69066204b2" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Lock "cinder-quobyte-c10a7b82-549a-474f-a64a-9c69066204b2" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864814d-c52a-452e-885c-7c60d7a5ea59]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:22 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2 Sep 08 07:29:22 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:22 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658" returned: 0 in 0.466s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:22 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 is being set with open permissions: ugo+rw Sep 08 07:29:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:22 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 Sep 08 07:29:22 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:23 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2" returned: 0 in 0.548s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:23 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2 Sep 08 07:29:23 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:23 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658" returned: 0 in 0.308s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:23 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6c6437fd-9212-47e1-9625-c4f9ab76eb08 tempest-VolumesDeleteCascade-1346707237 None] Create snapshot completed successfully Sep 08 07:29:23 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c10a7b82-549a-474f-a64a-9c69066204b2" returned: 0 in 0.368s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Lock "cinder-quobyte-c10a7b82-549a-474f-a64a-9c69066204b2" released by "delete_volume" :: held 0.998s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-c042f8cb-d76c-4195-b7ea-efb2649a71e6-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:23 devstack cinder-volume[87278]: WARNING cinder.quota [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1643657427 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1643657427, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:29:23 devstack cinder-volume[87278]: WARNING cinder.quota [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1643657427 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1643657427, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-c042f8cb-d76c-4195-b7ea-efb2649a71e6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Created reservations ['29191a22-1fbc-4ab3-a884-3fe927a9d379', '849a4d64-8ea7-4b9d-80df-789a416628b5', '99317e2d-6316-4186-8c20-d2ef3d36f4c3', '111ac94d-4250-482e-9d9f-ef2163fa0768'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Performing cascade delete. {{(pid=87278) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-15704598-45da-4177-8365-6e0f878a720b-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-15704598-45da-4177-8365-6e0f878a720b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-c042f8cb-d76c-4195-b7ea-efb2649a71e6" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:23 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-c042f8cb-d76c-4195-b7ea-efb2649a71e6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-15704598-45da-4177-8365-6e0f878a720b" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:23 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-15704598-45da-4177-8365-6e0f878a720b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Deleting offline snapshot 15704598-45da-4177-8365-6e0f878a720b of volume c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:29:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] snapshot_file for this snap is: volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[494fccdf-95bb-448b-9016-563b71adac2b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:24 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b Sep 08 07:29:24 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:24 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.321s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:29:24 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Deleted volume successfully. Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-715e19bf-b11a-4af0-9ca5-3e48034ae3ea tempest-VolumeTypesAccessTest-321395011 None] Lock "cinder-c10a7b82-549a-474f-a64a-9c69066204b2-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:24 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b" returned: 0 in 0.469s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6722d441-2457-40a9-90e9-fee7443a79f9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:24 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 Sep 08 07:29:24 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:24 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6" returned: 0 in 0.421s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7659d6-d100-4449-8597-57e9eb463ba7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:25 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 Sep 08 07:29:25 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:25 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658" returned: 0 in 0.455s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6320e888-c88c-4585-b9f7-4b09f5644322]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:25 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b Sep 08 07:29:25 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:25 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b" returned: 0 in 0.461s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a1c6e8-28e7-4eb7-ae1f-71825e0b7a39]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:26 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 Sep 08 07:29:26 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:26 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6" returned: 0 in 0.588s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:26 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b Sep 08 07:29:26 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:27 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b" returned: 0 in 0.530s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:27 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b Sep 08 07:29:27 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:27 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.15704598-45da-4177-8365-6e0f878a720b" returned: 0 in 0.382s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 -F qcow2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:27 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 -F qcow2 Sep 08 07:29:27 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:27 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 -F qcow2" returned: 0 in 0.465s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-15704598-45da-4177-8365-6e0f878a720b" released by "_delete_snapshot" :: held 4.061s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-c042f8cb-d76c-4195-b7ea-efb2649a71e6" released by "delete_snapshot" :: held 4.105s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Created reservations ['6630cd70-7d6f-44c8-879f-f2b89eebb722', 'a79578fa-7505-44f1-9876-a322effa8c31', '33d50650-03a1-4415-b863-3c1260c62d5b', 'b02a1492-20ad-4b65-8d68-34af1869d9e7'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:28 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Delete snapshot completed successfully. Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-15704598-45da-4177-8365-6e0f878a720b-delete_snapshot" released by "delete_snapshot" :: held 4.422s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-c0b0add5-1fc5-49a1-b6d2-bb42b9603658-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-c0b0add5-1fc5-49a1-b6d2-bb42b9603658-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-c042f8cb-d76c-4195-b7ea-efb2649a71e6" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-c042f8cb-d76c-4195-b7ea-efb2649a71e6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-c0b0add5-1fc5-49a1-b6d2-bb42b9603658" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-c0b0add5-1fc5-49a1-b6d2-bb42b9603658" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Deleting offline snapshot c0b0add5-1fc5-49a1-b6d2-bb42b9603658 of volume c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] snapshot_file for this snap is: volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b272b06-0040-4efa-af5f-8c669f72671a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:28 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 Sep 08 07:29:28 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:29 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658" returned: 0 in 0.584s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:29:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab9f8f6-ae60-4547-bcc5-a0d7d30939a3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:29 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 Sep 08 07:29:29 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:29 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6" returned: 0 in 0.440s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:29 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 Sep 08 07:29:29 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:29 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658" returned: 0 in 0.393s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:29 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658 Sep 08 07:29:29 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:30 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6.c0b0add5-1fc5-49a1-b6d2-bb42b9603658" returned: 0 in 0.280s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-c0b0add5-1fc5-49a1-b6d2-bb42b9603658" released by "_delete_snapshot" :: held 1.881s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-c042f8cb-d76c-4195-b7ea-efb2649a71e6" released by "delete_snapshot" :: held 1.914s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Created reservations ['f4de942e-92fc-4216-9435-c57118461637', 'c888c637-8773-45f6-8c22-0098b6622679', 'cb23db03-6660-4e1d-8f4f-55057563ed39', '7ba5a479-a633-40dd-8406-377430d4f911'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:30 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Delete snapshot completed successfully. Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-c0b0add5-1fc5-49a1-b6d2-bb42b9603658-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Snapshots deleted, issuing volume delete {{(pid=87278) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-c042f8cb-d76c-4195-b7ea-efb2649a71e6" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-c042f8cb-d76c-4195-b7ea-efb2649a71e6" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f6af6a-61a7-4fa6-a18a-fe950964b36b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:30 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 Sep 08 07:29:30 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:31 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6" returned: 0 in 0.486s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:31 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6 Sep 08 07:29:31 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:31 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c042f8cb-d76c-4195-b7ea-efb2649a71e6" returned: 0 in 0.285s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-c042f8cb-d76c-4195-b7ea-efb2649a71e6" released by "delete_volume" :: held 0.864s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Created reservations ['151b53c4-42d2-48bd-aebd-54b7532a7412', 'a0612ad8-d877-4942-953c-29a08ed61fcf', '36f1d0b7-ed1e-43db-8c6b-ed5ce34bf03e', '0be65840-b7ba-46ef-853e-444fe6dff8f1'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:31 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:29:31 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.317s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:29:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Deleted volume successfully. Sep 08 07:29:31 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92d02558-0bb2-427f-8400-0a367e5b5b64 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-c042f8cb-d76c-4195-b7ea-efb2649a71e6-delete_volume" released by "delete_volume" :: held 8.268s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Flow 'volume_create_manager' (e7e60e68-85c8-4985-a3c5-3f4ac9626350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9161e82e-256e-443a-9268-d0038027112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9161e82e-256e-443a-9268-d0038027112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-550898111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c77dbd-0cab-4357-ad52-9ff4cb4a6c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ffa19e0fe8425597228c7f4b3b1c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:35Z,use_quota=True,user_id='c7d4bba621ea492080a4ca842cd1926e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2343f9-80ca-4ca7-a0c6-71cffac100e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2343f9-80ca-4ca7-a0c6-71cffac100e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b612a88-a932-4aec-8280-c206d33bdd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b612a88-a932-4aec-8280-c206d33bdd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c77dbd-0cab-4357-ad52-9ff4cb4a6c02', 'volume_name': 'volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea92cb49-5de9-4409-8e38-da1f0ecda576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea92cb49-5de9-4409-8e38-da1f0ecda576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9620b4-a91d-4790-8ea2-9338e5fde8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:35 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Volume 32c77dbd-0cab-4357-ad52-9ff4cb4a6c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02', 'volume_size': 1} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-550898111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c77dbd-0cab-4357-ad52-9ff4cb4a6c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ffa19e0fe8425597228c7f4b3b1c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:35Z,use_quota=True,user_id='c7d4bba621ea492080a4ca842cd1926e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Creating volume 32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:29:35 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:29:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:35 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 1073741824 Sep 08 07:29:35 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:36 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 1073741824" returned: 0 in 1.127s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:36 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 Sep 08 07:29:36 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:37 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" returned: 0 in 0.622s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9620b4-a91d-4790-8ea2-9338e5fde8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077120aa-d7fa-461e-98e0-cf6a8275c398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:37 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Volume volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 (32c77dbd-0cab-4357-ad52-9ff4cb4a6c02): created successfully Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077120aa-d7fa-461e-98e0-cf6a8275c398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Flow 'volume_create_manager' (e7e60e68-85c8-4985-a3c5-3f4ac9626350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2efaaa09-4fd1-42f1-9ce2-f1b9b9bd1cb5 tempest-VolumesDeleteCascade-1346707237 None] Created volume successfully. Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (8e8938c6-e740-4faf-91cb-fafbdd7d6acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e44a9f3-02f5-40a4-b6e5-c0105c920710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e44a9f3-02f5-40a4-b6e5-c0105c920710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-312933550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85244f08-410c-43e5-a4c5-9dc086ab6ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:38Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaf89a1-c4f9-4395-8221-7e1517c7bec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaf89a1-c4f9-4395-8221-7e1517c7bec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220020ac-cfe3-4cb8-946e-e25aa7574a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220020ac-cfe3-4cb8-946e-e25aa7574a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85244f08-410c-43e5-a4c5-9dc086ab6ca9', 'volume_name': 'volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f1bc92-dc58-48b2-98ba-2d07f711a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f1bc92-dc58-48b2-98ba-2d07f711a881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec692c50-5a78-4a7b-9b64-b557f63fe05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:37 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Volume 85244f08-410c-43e5-a4c5-9dc086ab6ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9', 'volume_size': 1} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-312933550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85244f08-410c-43e5-a4c5-9dc086ab6ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:38Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Creating volume 85244f08-410c-43e5-a4c5-9dc086ab6ca9 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:29:37 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:29:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:37 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 1073741824 Sep 08 07:29:37 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:38 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 1073741824" returned: 0 in 0.860s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:38 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 Sep 08 07:29:38 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:38 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9" returned: 0 in 0.320s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:29:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.251s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Creating offline snapshot cb9c9e7c-f666-48b5-840f-dc80fba7d178 of volume 32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec692c50-5a78-4a7b-9b64-b557f63fe05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4233c959-a5f8-4c8d-b61a-6c962c3a495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7678977f-9f89-4112-b2b3-88c13fece0ce]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:39 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Volume volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 (85244f08-410c-43e5-a4c5-9dc086ab6ca9): created successfully Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4233c959-a5f8-4c8d-b61a-6c962c3a495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (8e8938c6-e740-4faf-91cb-fafbdd7d6acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:39 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fa4d5b63-fcf9-4b0d-a983-e46fa1f582bb tempest-VolumesActionsTest-1859912618 None] Created volume successfully. Sep 08 07:29:39 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 Sep 08 07:29:39 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:39 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" returned: 0 in 0.757s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:39 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 1G Sep 08 07:29:39 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e952c58f-12fc-4b11-918e-e2bcd5d4ae15 tempest-VolumesActionsTest-1859912618 None] Acquiring lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9" by "attach_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e952c58f-12fc-4b11-918e-e2bcd5d4ae15 tempest-VolumesActionsTest-1859912618 None] Lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9" acquired by "attach_volume" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e952c58f-12fc-4b11-918e-e2bcd5d4ae15 tempest-VolumesActionsTest-1859912618 None] Attaching volume 85244f08-410c-43e5-a4c5-9dc086ab6ca9 to instance 71a709a6-4213-41fc-9e82-6f27912b372c at mountpoint /dev/vdb on host None. Sep 08 07:29:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e952c58f-12fc-4b11-918e-e2bcd5d4ae15 tempest-VolumesActionsTest-1859912618 None] Attach volume completed successfully. Sep 08 07:29:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e952c58f-12fc-4b11-918e-e2bcd5d4ae15 tempest-VolumesActionsTest-1859912618 None] Lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9" released by "attach_volume" :: held 0.271s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:40 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 1G" returned: 0 in 0.717s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:40 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 Sep 08 07:29:40 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:41 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178" returned: 0 in 0.710s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:41 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 is being set with open permissions: ugo+rw Sep 08 07:29:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:41 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 Sep 08 07:29:41 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6251600b-f5f9-44ab-93df-1d96352e6c61 tempest-VolumesActionsTest-237219578 None] Terminate volume connection completed successfully. Sep 08 07:29:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6251600b-f5f9-44ab-93df-1d96352e6c61 tempest-VolumesActionsTest-237219578 None] Acquiring lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9-detach_volume" by "detach_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6251600b-f5f9-44ab-93df-1d96352e6c61 tempest-VolumesActionsTest-237219578 None] Lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6251600b-f5f9-44ab-93df-1d96352e6c61 tempest-VolumesActionsTest-237219578 None] Detaching volume 85244f08-410c-43e5-a4c5-9dc086ab6ca9 from instance 71a709a6-4213-41fc-9e82-6f27912b372c. Sep 08 07:29:41 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178" returned: 0 in 0.520s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6251600b-f5f9-44ab-93df-1d96352e6c61 tempest-VolumesActionsTest-237219578 None] Detach volume completed successfully. Sep 08 07:29:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6251600b-f5f9-44ab-93df-1d96352e6c61 tempest-VolumesActionsTest-237219578 None] Lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9-detach_volume" released by "detach_volume" :: held 0.168s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:41 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.info Sep 08 07:29:41 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d728896e-b6a2-43c0-8ed4-04bd471faf74 tempest-VolumesActionsTest-1859912618 None] Acquiring lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9-detach_volume" by "detach_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d728896e-b6a2-43c0-8ed4-04bd471faf74 tempest-VolumesActionsTest-1859912618 None] Lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d728896e-b6a2-43c0-8ed4-04bd471faf74 tempest-VolumesActionsTest-1859912618 None] Volume detach called, but volume not attached. Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d728896e-b6a2-43c0-8ed4-04bd471faf74 tempest-VolumesActionsTest-1859912618 None] Lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:42 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.info" returned: 0 in 0.517s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:42 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.info is being set with open permissions: ugo+rw Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:42 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.info Sep 08 07:29:42 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Acquiring lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Acquiring lock "cinder-quobyte-85244f08-410c-43e5-a4c5-9dc086ab6ca9" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Lock "cinder-quobyte-85244f08-410c-43e5-a4c5-9dc086ab6ca9" acquired by "delete_volume" :: waited 0.034s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:42 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.info" returned: 0 in 0.437s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.798s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dfa233-14d8-4939-86c3-418e16365f12]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d0349895-aacf-4ab9-bc3c-dcc2b7f36e5b tempest-VolumesDeleteCascade-1346707237 None] Create snapshot completed successfully Sep 08 07:29:42 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 Sep 08 07:29:42 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:43 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9" returned: 0 in 0.498s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:43 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9 Sep 08 07:29:43 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:43 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-85244f08-410c-43e5-a4c5-9dc086ab6ca9" returned: 0 in 0.440s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Lock "cinder-quobyte-85244f08-410c-43e5-a4c5-9dc086ab6ca9" released by "delete_volume" :: held 1.027s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:43 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Created reservations ['c6b103cb-ebc7-4c14-b7d9-dff4c1fda377', 'e1b44483-3f31-4764-a5b4-90dbcaaa31e1', '87afcb0a-039f-4497-aee6-076b2866837f', '15f05dba-7903-4f40-af33-244b78df3533'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:44 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:29:44 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Flow 'volume_create_manager' (9461ba80-d593-4c8b-b2aa-bccfd78628d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfeebfa-0261-459c-b492-7cdf89223b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfeebfa-0261-459c-b492-7cdf89223b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1449477258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4504cb6f-7239-4a1c-ab7a-ffceeb52ee75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ffa19e0fe8425597228c7f4b3b1c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb9c9e7c-f666-48b5-840f-dc80fba7d178,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:44Z,use_quota=True,user_id='c7d4bba621ea492080a4ca842cd1926e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124b60b2-6be0-48a9-b02c-28d294e18f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124b60b2-6be0-48a9-b02c-28d294e18f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd57b5ad-a683-42d0-b7dc-d42ab75da799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd57b5ad-a683-42d0-b7dc-d42ab75da799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4504cb6f-7239-4a1c-ab7a-ffceeb52ee75', 'volume_name': 'volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75', 'volume_size': 1, 'snapshot_id': 'cb9c9e7c-f666-48b5-840f-dc80fba7d178'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318305bf-c966-4820-95e0-ca9d3ffb34db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318305bf-c966-4820-95e0-ca9d3ffb34db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e57a57c-c26b-4df0-ac73-a1494e251e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:44 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Volume 4504cb6f-7239-4a1c-ab7a-ffceeb52ee75: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75', 'volume_size': 1, 'snapshot_id': 'cb9c9e7c-f666-48b5-840f-dc80fba7d178'} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-cb9c9e7c-f666-48b5-840f-dc80fba7d178-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" by "_create_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-cb9c9e7c-f666-48b5-840f-dc80fba7d178-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Creating volume 4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 from snapshot cb9c9e7c-f666-48b5-840f-dc80fba7d178 {{(pid=87278) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] snapshot: cb9c9e7c-f666-48b5-840f-dc80fba7d178, volume: 4504cb6f-7239-4a1c-ab7a-ffceeb52ee75, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:44 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.443s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac4646f-0c27-4507-9ec2-ede1906671ca]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:44 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Deleted volume successfully. Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f993c97c-d145-40d7-8686-e4f994bb55bd tempest-VolumesActionsTest-1859912618 None] Lock "cinder-85244f08-410c-43e5-a4c5-9dc086ab6ca9-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:44 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 Sep 08 07:29:44 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:44 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:29:44 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:45 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.424s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:29:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:29:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:29:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:29:45 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178" returned: 0 in 0.852s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:29:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f3f6b1-e924-49b3-936d-6c55cbac6b34]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:45 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 Sep 08 07:29:45 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:46 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" returned: 0 in 0.588s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:29:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:29:46 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:29:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:46 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 Sep 08 07:29:46 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (ae763df9-a05e-423e-b113-72cba9b00a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf2665f-7ad2-4c57-9df3-fc1c7d74d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf2665f-7ad2-4c57-9df3-fc1c7d74d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1689749994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9697791-1550-41e9-9bdc-dd1fb728ca1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:52Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c28c2a-e3fc-4410-bbdb-d3960abc44b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c28c2a-e3fc-4410-bbdb-d3960abc44b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f42ffe-facf-4f4e-91e5-5949a5e2e538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f42ffe-facf-4f4e-91e5-5949a5e2e538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9697791-1550-41e9-9bdc-dd1fb728ca1a', 'volume_name': 'volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96907e0f-dee1-4844-9e38-2290ced8515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96907e0f-dee1-4844-9e38-2290ced8515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139d73f5-92a2-42bd-8819-f72fdc12f608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:52 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Volume a9697791-1550-41e9-9bdc-dd1fb728ca1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a', 'volume_size': 1} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:52 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" returned: 0 in 6.538s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:29:52 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Converted 1024.00 MB image at 156.60 MB/s Sep 08 07:29:52 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 is being set with open permissions: ugo+rw Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:52 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 Sep 08 07:29:52 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:52 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Flow 'volume_create_manager' (79d330c7-c4a8-4cac-bf16-51c989f55798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfa4846-522b-447d-ab68-752463b1da1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" returned: 0 in 0.343s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" released by "_copy_volume_from_snapshot" :: held 8.487s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfa4846-522b-447d-ab68-752463b1da1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1475076194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138bab64-d43f-4442-b2c0-c7582575bcc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8e8c1bea594483a310ace940bb63ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:53Z,use_quota=True,user_id='ef8e07445c92445fa0eaca2c75e95e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168938f9-64f0-4851-bb87-77379c20ef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168938f9-64f0-4851-bb87-77379c20ef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342fdca3-fb98-481b-a1bf-6ce924ca89db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:52 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-cb9c9e7c-f666-48b5-840f-dc80fba7d178-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" released by "_create_volume_from_snapshot" :: held 8.635s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.662s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.509s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1689749994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9697791-1550-41e9-9bdc-dd1fb728ca1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:52Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Creating volume a9697791-1550-41e9-9bdc-dd1fb728ca1a {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:29:53 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:53 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a 1073741824 Sep 08 07:29:53 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e57a57c-c26b-4df0-ac73-a1494e251e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75', 'volume_size': 1, 'snapshot_id': 'cb9c9e7c-f666-48b5-840f-dc80fba7d178'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b60044-0fb3-430b-bed9-efc345b5d950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:53 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Volume volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 (4504cb6f-7239-4a1c-ab7a-ffceeb52ee75): created successfully Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b60044-0fb3-430b-bed9-efc345b5d950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Flow 'volume_create_manager' (9461ba80-d593-4c8b-b2aa-bccfd78628d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:53 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6923723b-fe89-466b-85a8-5ddbbb296791 tempest-VolumesDeleteCascade-1346707237 None] Created volume successfully. Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342fdca3-fb98-481b-a1bf-6ce924ca89db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '138bab64-d43f-4442-b2c0-c7582575bcc0', 'volume_name': 'volume-138bab64-d43f-4442-b2c0-c7582575bcc0', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62788995-a137-4ccf-89f2-a624f02064ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62788995-a137-4ccf-89f2-a624f02064ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74ff382-ac6f-4540-8a29-55fd876d1e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:53 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Volume 138bab64-d43f-4442-b2c0-c7582575bcc0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-138bab64-d43f-4442-b2c0-c7582575bcc0', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Trying to clone 138bab64-d43f-4442-b2c0-c7582575bcc0 from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:29:53 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a 1073741824" returned: 0 in 0.599s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:53 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a Sep 08 07:29:53 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:29:53 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Image download 20.69 MB at 20.69 MB/s Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Performing cascade delete. {{(pid=87278) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-cb9c9e7c-f666-48b5-840f-dc80fba7d178-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-cb9c9e7c-f666-48b5-840f-dc80fba7d178-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:53 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab332128-9041-4108-b68a-a25edf6f8f4e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:54 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a" returned: 0 in 0.344s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139d73f5-92a2-42bd-8819-f72fdc12f608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801dd61b-8f85-4c91-8cbc-29249a9ddc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-cb9c9e7c-f666-48b5-840f-dc80fba7d178" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-cb9c9e7c-f666-48b5-840f-dc80fba7d178" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Deleting offline snapshot cb9c9e7c-f666-48b5-840f-dc80fba7d178 of volume 32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] snapshot_file for this snap is: volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:29:54 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Volume volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a (a9697791-1550-41e9-9bdc-dd1fb728ca1a): created successfully Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801dd61b-8f85-4c91-8cbc-29249a9ddc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (ae763df9-a05e-423e-b113-72cba9b00a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0e318d-84c8-4129-b245-a5265898b7f0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:54 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-17c8a92b-0277-410a-ae54-643eb8d34338 tempest-VolumesActionsTest-1859912618 None] Created volume successfully. Sep 08 07:29:54 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD Sep 08 07:29:54 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:54 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 Sep 08 07:29:54 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Acquiring lock "cinder-a9697791-1550-41e9-9bdc-dd1fb728ca1a-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:54 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Lock "cinder-a9697791-1550-41e9-9bdc-dd1fb728ca1a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD" returned: 0 in 0.607s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 is fetched for user ef8e07445c92445fa0eaca2c75e95e90. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Acquiring lock "cinder-quobyte-a9697791-1550-41e9-9bdc-dd1fb728ca1a" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Lock "cinder-quobyte-a9697791-1550-41e9-9bdc-dd1fb728ca1a" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03b5520-096b-455e-a5f6-e8184cd7f238]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:54 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178" returned: 0 in 0.609s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a0ce9-09c8-4bfb-ade1-7402535ef62b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[973de725-af46-4fcb-a40d-f730cfec6f3d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:54 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a Sep 08 07:29:54 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:54 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 Sep 08 07:29:54 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:55 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD Sep 08 07:29:55 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:55 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a" returned: 0 in 0.491s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:55 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a Sep 08 07:29:55 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:55 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD" returned: 0 in 0.553s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1475076194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138bab64-d43f-4442-b2c0-c7582575bcc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8e8c1bea594483a310ace940bb63ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:53Z,use_quota=True,user_id='ef8e07445c92445fa0eaca2c75e95e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Creating volume 138bab64-d43f-4442-b2c0-c7582575bcc0 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:29:55 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:55 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" returned: 0 in 0.658s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:55 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 1073741824 Sep 08 07:29:55 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:55 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 Sep 08 07:29:55 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:55 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a9697791-1550-41e9-9bdc-dd1fb728ca1a" returned: 0 in 0.421s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Lock "cinder-quobyte-a9697791-1550-41e9-9bdc-dd1fb728ca1a" released by "delete_volume" :: held 0.992s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Created reservations ['6a94e538-0bba-4c78-8f03-22b638731b79', '7dd99203-8e72-4291-b91d-7623bbfe3e10', '390b0dc9-f13e-4325-86fb-dc8696cb5421', 'fa1db2d4-b673-4bfb-b22c-d39cf25dacae'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:55 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:29:55 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:56 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178" returned: 0 in 0.574s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:56 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178 Sep 08 07:29:56 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:56 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 1073741824" returned: 0 in 0.730s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:56 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.342s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:29:56 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 Sep 08 07:29:56 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Deleted volume successfully. Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cb03450c-dcf9-47a6-8baa-ce21e7db26a9 tempest-VolumesActionsTest-237219578 None] Lock "cinder-a9697791-1550-41e9-9bdc-dd1fb728ca1a-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:56 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02.cb9c9e7c-f666-48b5-840f-dc80fba7d178" returned: 0 in 0.376s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-cb9c9e7c-f666-48b5-840f-dc80fba7d178" released by "_delete_snapshot" :: held 2.365s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" released by "delete_snapshot" :: held 2.394s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:56 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0" returned: 0 in 0.355s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Created reservations ['c5aaff99-2d1d-49ad-a9d0-269dd0573c00', '2ccbd9a8-b8a4-4e90-b7c7-273f7942b68e', 'b60bb183-5487-45e8-b8b8-c29b39eec673', 'f322f71d-5d73-4ec5-8158-524f9bcafbe1'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Attempting download of cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume 138bab64-d43f-4442-b2c0-c7582575bcc0. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c2905-581b-4c2b-83f0-66aee089c365]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125__gahq0qb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Delete snapshot completed successfully. Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-cb9c9e7c-f666-48b5-840f-dc80fba7d178-delete_snapshot" released by "delete_snapshot" :: held 2.708s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Snapshots deleted, issuing volume delete {{(pid=87278) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a56da2-bd8d-402f-9dae-248fb973289e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:56 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125__gahq0qb Sep 08 07:29:56 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:56 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 Sep 08 07:29:56 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:57 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125__gahq0qb" returned: 0 in 0.502s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125__gahq0qb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:57 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" returned: 0 in 0.518s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:57 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02 Sep 08 07:29:57 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:57 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125__gahq0qb Sep 08 07:29:57 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:57 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" returned: 0 in 0.375s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02" released by "delete_volume" :: held 0.982s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:57 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125__gahq0qb" returned: 1 in 0.596s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125__gahq0qb' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ca02fd-bd1b-40a0-a600-9c4b2d22b754]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Created reservations ['d5d3f0b1-348b-4edc-89cd-808800d89330', '94ec8c00-c0a5-4916-95d4-067299572202', 'b0e34318-58cb-489f-a8c4-f7e82243c823', 'd45134b5-8e0f-4bb7-aafd-a44fd16bd18d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (ffe7b41e-1fbb-4479-a650-a092063de259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96f91ce-12fe-4b63-978c-6c3b57ef7b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96f91ce-12fe-4b63-978c-6c3b57ef7b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-221548043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0968d482-5c5c-4e3c-a06a-6891b6704827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:58Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e22e249-e1f5-4a01-83a1-2331c393333b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e22e249-e1f5-4a01-83a1-2331c393333b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0e5371-e6a3-4095-b25b-b93a8f37b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0e5371-e6a3-4095-b25b-b93a8f37b538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0968d482-5c5c-4e3c-a06a-6891b6704827', 'volume_name': 'volume-0968d482-5c5c-4e3c-a06a-6891b6704827', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55bccbd-c2a9-4bdf-be15-94a75dd11c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55bccbd-c2a9-4bdf-be15-94a75dd11c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07784aec-2483-451d-bab1-070475ba2c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:57 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Volume 0968d482-5c5c-4e3c-a06a-6891b6704827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0968d482-5c5c-4e3c-a06a-6891b6704827', 'volume_size': 1} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:57 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-221548043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0968d482-5c5c-4e3c-a06a-6891b6704827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:29:58Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Creating volume 0968d482-5c5c-4e3c-a06a-6891b6704827 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:57 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:29:57 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:57 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827 1073741824 Sep 08 07:29:57 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:58 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:29:58 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:58 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 was qcow2, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:58 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 Sep 08 07:29:58 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:58 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.398s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:29:58 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Deleted volume successfully. Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e8d1bd53-715f-4d5e-a4f4-ea7fa84c8e8d tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-32c77dbd-0cab-4357-ad52-9ff4cb4a6c02-delete_volume" released by "delete_volume" :: held 4.556s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:58 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827 1073741824" returned: 0 in 0.766s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "cinder-quobyte-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:29:58 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827 Sep 08 07:29:58 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e935c398-a834-4de5-897f-b39bc7042df2]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:29:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:59 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 Sep 08 07:29:59 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:59 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827" returned: 0 in 0.489s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07784aec-2483-451d-bab1-070475ba2c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0968d482-5c5c-4e3c-a06a-6891b6704827', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e6d294-1a35-485b-ae0e-a748f3624a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:29:59 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Volume volume-0968d482-5c5c-4e3c-a06a-6891b6704827 (0968d482-5c5c-4e3c-a06a-6891b6704827): created successfully Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e6d294-1a35-485b-ae0e-a748f3624a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (ffe7b41e-1fbb-4479-a650-a092063de259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:29:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f9ccbf04-567e-4934-bafc-19273ec4f25e tempest-VolumesActionsTest-1859912618 None] Created volume successfully. Sep 08 07:29:59 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" returned: 0 in 0.629s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:29:59 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75 Sep 08 07:29:59 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:29:59 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" returned: 0 in 0.387s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-quobyte-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75" released by "delete_volume" :: held 1.079s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=117,cinder:SELECT=106,cinder:DELETE=13,cinder:INSERT=35 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:29:59 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Created reservations ['520a8f58-405f-40ac-b932-e947919fab34', '1b42b37f-917f-41a2-82a4-4b086f1bc9d8', 'd2a3e701-4cc2-49ce-af83-18d1ec6d39f2', 'ef70370c-afb5-433c-b31d-8be76f538c42'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Acquiring lock "cinder-0968d482-5c5c-4e3c-a06a-6891b6704827-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:00 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:00 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Lock "cinder-0968d482-5c5c-4e3c-a06a-6891b6704827-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Acquiring lock "cinder-quobyte-0968d482-5c5c-4e3c-a06a-6891b6704827" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Lock "cinder-quobyte-0968d482-5c5c-4e3c-a06a-6891b6704827" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[374c92a3-d49c-4a4b-8b95-7dd972366d28]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:00 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.290s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:00 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827 Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:00 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:00 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Deleted volume successfully. Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-426d9a93-5b96-4f94-abf8-2c72a049bef2 tempest-VolumesDeleteCascade-1346707237 None] Lock "cinder-4504cb6f-7239-4a1c-ab7a-ffceeb52ee75-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:00 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827" returned: 0 in 0.483s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:00 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0" returned: 0 in 2.574s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_3jeyq0r3devstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:30:00 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Converted 112.00 MB image at 43.48 MB/s Sep 08 07:30:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:00 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827 Sep 08 07:30:00 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:00 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 1G Sep 08 07:30:00 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:01 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-0968d482-5c5c-4e3c-a06a-6891b6704827" returned: 0 in 0.326s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Lock "cinder-quobyte-0968d482-5c5c-4e3c-a06a-6891b6704827" released by "delete_volume" :: held 0.866s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:01 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 1G" returned: 0 in 0.404s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Downloaded image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume 138bab64-d43f-4442-b2c0-c7582575bcc0 successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 for user ef8e07445c92445fa0eaca2c75e95e90 is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Marking volume 138bab64-d43f-4442-b2c0-c7582575bcc0 as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Created reservations ['2cdd48dc-b5b3-46dc-a6a2-b410a1521cf2', '64e2bdef-4fdb-485a-bfa1-ff2f7221a0c7', 'a10f0da6-bd94-4b92-b048-55db8aa141b1', 'fbfd3bf4-d248-4958-b5d2-b270f0f2edab'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Copying metadata from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 to 138bab64-d43f-4442-b2c0-c7582575bcc0. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Creating volume glance metadata for volume 138bab64-d43f-4442-b2c0-c7582575bcc0 backed by image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:01 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:01 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74ff382-ac6f-4540-8a29-55fd876d1e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138bab64-d43f-4442-b2c0-c7582575bcc0', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f842b7-080d-4170-b5cd-b496a700438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:01 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Volume volume-138bab64-d43f-4442-b2c0-c7582575bcc0 (138bab64-d43f-4442-b2c0-c7582575bcc0): created successfully Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f842b7-080d-4170-b5cd-b496a700438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Flow 'volume_create_manager' (79d330c7-c4a8-4cac-bf16-51c989f55798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8cc0cdf5-5fbf-478f-b715-1b945c701ba6 tempest-VolumesImageMetadata-2059576063 None] Created volume successfully. Sep 08 07:30:01 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.319s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Deleted volume successfully. Sep 08 07:30:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32b7e6ca-bbe2-4d13-8598-94d5bb2001fc tempest-VolumesActionsTest-237219578 None] Lock "cinder-0968d482-5c5c-4e3c-a06a-6891b6704827-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Acquiring lock "cinder-138bab64-d43f-4442-b2c0-c7582575bcc0-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Lock "cinder-138bab64-d43f-4442-b2c0-c7582575bcc0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Acquiring lock "cinder-quobyte-138bab64-d43f-4442-b2c0-c7582575bcc0" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Lock "cinder-quobyte-138bab64-d43f-4442-b2c0-c7582575bcc0" acquired by "delete_volume" :: waited 0.035s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:02 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e8310-f983-4d94-a056-faa32c0ecaff]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:02 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 Sep 08 07:30:02 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (4fd1b65e-e31e-4390-99ce-d4ff3b897941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6291748-d6a0-474a-8f74-0da2cb302487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6291748-d6a0-474a-8f74-0da2cb302487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-416875938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c47bb25-a5e1-43a4-a8ed-98b0c19fad38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:03Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:03 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8cb695-5d18-45bb-954d-3b354ab11c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8cb695-5d18-45bb-954d-3b354ab11c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7350cb33-cf79-4f92-ae21-d23872c417c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7350cb33-cf79-4f92-ae21-d23872c417c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c47bb25-a5e1-43a4-a8ed-98b0c19fad38', 'volume_name': 'volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eca65d9-82fd-4496-b1e1-f0058c723f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eca65d9-82fd-4496-b1e1-f0058c723f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86aa9954-e442-4b4b-83ba-08ea2695bf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:03 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Volume 7c47bb25-a5e1-43a4-a8ed-98b0c19fad38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38', 'volume_size': 1} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-416875938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c47bb25-a5e1-43a4-a8ed-98b0c19fad38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:03Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Creating volume 7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:30:03 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0" returned: 0 in 0.614s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:03 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 1073741824 Sep 08 07:30:03 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:03 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0 Sep 08 07:30:03 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:03 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-138bab64-d43f-4442-b2c0-c7582575bcc0" returned: 0 in 0.358s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Lock "cinder-quobyte-138bab64-d43f-4442-b2c0-c7582575bcc0" released by "delete_volume" :: held 1.036s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Created reservations ['1dba2195-b382-45eb-97b9-ce1c73d85a89', 'c1007a18-5bb0-474d-bf31-22dab3d9a556', 'f7326f76-3171-4445-9660-d556774a4193', '3fd78193-343d-4a29-8c74-3412fe007f40'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=117,cinder:INSERT=36,cinder:UPDATE=131,cinder:DELETE=9 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:03 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:03 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:03 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 1073741824" returned: 0 in 0.645s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:03 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 Sep 08 07:30:03 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:04 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.301s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Deleted volume successfully. Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f470bd0-2920-42cd-a013-e73a51b6ed15 tempest-VolumesImageMetadata-2059576063 None] Lock "cinder-138bab64-d43f-4442-b2c0-c7582575bcc0-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:04 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38" returned: 0 in 0.303s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86aa9954-e442-4b4b-83ba-08ea2695bf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f28c27-7d7b-45dc-9046-0997bac57fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:04 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Volume volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 (7c47bb25-a5e1-43a4-a8ed-98b0c19fad38): created successfully Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f28c27-7d7b-45dc-9046-0997bac57fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (4fd1b65e-e31e-4390-99ce-d4ff3b897941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a6881b98-c9fb-4726-b796-420d500d85c9 tempest-VolumesActionsTest-1859912618 None] Created volume successfully. Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Flow 'volume_create_manager' (d35ac552-1a8c-4665-9d42-fa9bc74e7fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296f6088-4ef3-4a72-a2b1-01e9ce0c4881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296f6088-4ef3-4a72-a2b1-01e9ce0c4881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1958267108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee13909-6ef5-44ee-b49a-8a7288bb9c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95add81e418471598747df2ccfdd81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:04Z,use_quota=True,user_id='9384826465134b85a30e4434d2871718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eee01ae-16b0-4cda-907f-5045f8928ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eee01ae-16b0-4cda-907f-5045f8928ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01637c2a-0e0f-44c9-946b-f66d3d886740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:04 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01637c2a-0e0f-44c9-946b-f66d3d886740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aee13909-6ef5-44ee-b49a-8a7288bb9c9e', 'volume_name': 'volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbfb4fe-d147-4dd3-bedb-baea1b5bdfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbfb4fe-d147-4dd3-bedb-baea1b5bdfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a7d0e5-5e8b-4139-bb2e-e923fe8d2fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:05 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Volume aee13909-6ef5-44ee-b49a-8a7288bb9c9e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Trying to clone aee13909-6ef5-44ee-b49a-8a7288bb9c9e from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Acquiring lock "cinder-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Lock "cinder-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Acquiring lock "cinder-quobyte-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Lock "cinder-quobyte-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b21102c-2fce-4876-bda1-969416c646a4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:30:05 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Image download 20.69 MB at 20.69 MB/s Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6b0689-7f06-4741-b72b-977639f99563]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:05 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 Sep 08 07:30:05 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:05 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD Sep 08 07:30:05 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:06 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38" returned: 0 in 0.545s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:06 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 is fetched for user 9384826465134b85a30e4434d2871718. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:30:06 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38 Sep 08 07:30:06 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f8ec07-a9c5-4e6e-99ba-780927dbf97e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:06 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD Sep 08 07:30:06 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:06 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38" returned: 0 in 0.285s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Lock "cinder-quobyte-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38" released by "delete_volume" :: held 0.930s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Created reservations ['c5ea6b59-db88-4d9e-b1f2-4d37cd00c5e0', '8c159a36-7458-472b-9495-b5678c4aff14', '39ff93b7-29bf-4d68-a15e-c3429326cce3', '356e1d01-ab49-474e-a068-d891cbc37aea'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:06 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:06 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1958267108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee13909-6ef5-44ee-b49a-8a7288bb9c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95add81e418471598747df2ccfdd81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:04Z,use_quota=True,user_id='9384826465134b85a30e4434d2871718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:30:06 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Creating volume aee13909-6ef5-44ee-b49a-8a7288bb9c9e {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:30:06 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:30:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:06 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e 1073741824 Sep 08 07:30:06 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:07 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.289s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:07 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Deleted volume successfully. Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5ebd341f-ff0e-45a9-a229-4e6ca0d97dc2 tempest-VolumesActionsTest-237219578 None] Lock "cinder-7c47bb25-a5e1-43a4-a8ed-98b0c19fad38-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:07 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e 1073741824" returned: 0 in 0.580s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:07 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e Sep 08 07:30:07 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:07 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e" returned: 0 in 0.305s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Attempting download of cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume aee13909-6ef5-44ee-b49a-8a7288bb9c9e. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc1aa36-a63b-4292-b902-e335a63fd35b]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_vegg5wia {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:08 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_vegg5wia Sep 08 07:30:08 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:08 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_vegg5wia" returned: 0 in 0.493s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_vegg5wia {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (92c85ec0-aa99-4e3b-b01a-2da37cd4862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c45691-845b-456c-b55b-cb026f5eab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c45691-845b-456c-b55b-cb026f5eab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929406201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e043ec-2922-43ad-98ae-6501ae4acbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:08Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1894a962-0fe2-45bb-ac26-9784db5e4c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:08 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_vegg5wia Sep 08 07:30:08 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1894a962-0fe2-45bb-ac26-9784db5e4c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93665a2-4918-486b-a31c-45451f71a77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93665a2-4918-486b-a31c-45451f71a77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e043ec-2922-43ad-98ae-6501ae4acbe4', 'volume_name': 'volume-69e043ec-2922-43ad-98ae-6501ae4acbe4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543baee7-a42f-4148-a083-a92f781e9cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543baee7-a42f-4148-a083-a92f781e9cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca89437a-e47c-4326-8532-c0d4a6eb9731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:08 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Volume 69e043ec-2922-43ad-98ae-6501ae4acbe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e043ec-2922-43ad-98ae-6501ae4acbe4', 'volume_size': 1} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929406201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e043ec-2922-43ad-98ae-6501ae4acbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:08Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Creating volume 69e043ec-2922-43ad-98ae-6501ae4acbe4 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:30:08 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:08 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 1073741824 Sep 08 07:30:08 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:08 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_vegg5wia" returned: 1 in 0.533s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_vegg5wia' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[009656ef-051f-4dd0-8600-48bd17c19769]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:09 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD Sep 08 07:30:09 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:09 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 1073741824" returned: 0 in 0.508s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:09 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 Sep 08 07:30:09 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:09 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 was qcow2, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:09 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e Sep 08 07:30:09 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:09 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4" returned: 0 in 0.328s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca89437a-e47c-4326-8532-c0d4a6eb9731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e043ec-2922-43ad-98ae-6501ae4acbe4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd167a36-3909-413e-8d98-b584967f1fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:09 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Volume volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 (69e043ec-2922-43ad-98ae-6501ae4acbe4): created successfully Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd167a36-3909-413e-8d98-b584967f1fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (92c85ec0-aa99-4e3b-b01a-2da37cd4862e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:09 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0a856f8e-18a2-4247-8b74-17daac2d6f9b tempest-VolumesActionsTest-1859912618 None] Created volume successfully. Sep 08 07:30:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Acquiring lock "cinder-69e043ec-2922-43ad-98ae-6501ae4acbe4-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Lock "cinder-69e043ec-2922-43ad-98ae-6501ae4acbe4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Acquiring lock "cinder-quobyte-69e043ec-2922-43ad-98ae-6501ae4acbe4" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Lock "cinder-quobyte-69e043ec-2922-43ad-98ae-6501ae4acbe4" acquired by "delete_volume" :: waited 0.039s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a370331-7116-4793-935d-e759378ab33d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:11 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 Sep 08 07:30:11 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:11 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4" returned: 0 in 0.595s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:11 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4 Sep 08 07:30:11 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:11 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e" returned: 0 in 2.535s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125_jtvtz2fedevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:30:11 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Converted 112.00 MB image at 44.15 MB/s Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:11 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e 1G Sep 08 07:30:11 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Flow 'volume_create_manager' (cb9e3ef5-987a-475f-812b-f54a08ffc90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3065ef3-bca5-4326-bca1-01ce6764ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3065ef3-bca5-4326-bca1-01ce6764ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1532813494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388834f7-66b1-42d4-8fa2-6f891951d386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f808ddc6e13943569bdb831002756505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:12Z,use_quota=True,user_id='e6ed74daa3d94ec3bd4c5c981274060e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b1331d-a949-428b-8fae-3573b1a872de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b1331d-a949-428b-8fae-3573b1a872de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3176ed-f8df-467f-b620-11f3b8165b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:11 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3176ed-f8df-467f-b620-11f3b8165b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388834f7-66b1-42d4-8fa2-6f891951d386', 'volume_name': 'volume-388834f7-66b1-42d4-8fa2-6f891951d386', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfbdef8-0c52-4582-a597-bdb66574790f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfbdef8-0c52-4582-a597-bdb66574790f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7994059e-6f3e-4b27-996c-45c8542f9518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:11 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Volume 388834f7-66b1-42d4-8fa2-6f891951d386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388834f7-66b1-42d4-8fa2-6f891951d386', 'volume_size': 1} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1532813494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388834f7-66b1-42d4-8fa2-6f891951d386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f808ddc6e13943569bdb831002756505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:12Z,use_quota=True,user_id='e6ed74daa3d94ec3bd4c5c981274060e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Creating volume 388834f7-66b1-42d4-8fa2-6f891951d386 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:30:11 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-69e043ec-2922-43ad-98ae-6501ae4acbe4" returned: 0 in 0.336s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Lock "cinder-quobyte-69e043ec-2922-43ad-98ae-6501ae4acbe4" released by "delete_volume" :: held 1.012s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:11 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386 1073741824 Sep 08 07:30:11 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Created reservations ['e6604baf-0511-4f70-96d4-33bdfffbba1a', 'b20685f8-41d6-4616-bc0f-de6dc5f5dfd6', 'd8aa4a81-cd3e-4f14-b2b4-4aac9d88e661', 'ebfe3399-5d6d-4b6f-ac12-f4966a5de475'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:12 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:12 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:12 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e 1G" returned: 0 in 0.473s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Downloaded image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 ((None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}])) to volume aee13909-6ef5-44ee-b49a-8a7288bb9c9e successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Temporary image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 for user 9384826465134b85a30e4434d2871718 is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Marking volume aee13909-6ef5-44ee-b49a-8a7288bb9c9e as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Copying metadata from image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 to aee13909-6ef5-44ee-b49a-8a7288bb9c9e. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Creating volume glance metadata for volume aee13909-6ef5-44ee-b49a-8a7288bb9c9e backed by image cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a7d0e5-5e8b-4139-bb2e-e923fe8d2fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e', 'volume_size': 1, 'image_id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a8b76708bb5a4a6d994cf20e5b6546cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125', 'created_at': datetime.datetime(2026, 9, 8, 5, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cac34e7b-5eb8-46fd-ab3b-55b5a2aa4125/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabbb615-bb75-4f76-ac8c-26e0177ca83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:12 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Volume volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e (aee13909-6ef5-44ee-b49a-8a7288bb9c9e): created successfully Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabbb615-bb75-4f76-ac8c-26e0177ca83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Flow 'volume_create_manager' (d35ac552-1a8c-4665-9d42-fa9bc74e7fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:12 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-41b379e5-fda8-4268-bb2d-a2e1ddb88644 tempest-TestShelveInstance-163993526 None] Created volume successfully. Sep 08 07:30:12 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.357s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:12 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Deleted volume successfully. Sep 08 07:30:12 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386 1073741824" returned: 0 in 0.576s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e46069db-3751-463c-9a92-a18ee5f690a3 tempest-VolumesActionsTest-237219578 None] Lock "cinder-69e043ec-2922-43ad-98ae-6501ae4acbe4-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:12 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386 Sep 08 07:30:12 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:12 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386" returned: 0 in 0.269s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7994059e-6f3e-4b27-996c-45c8542f9518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388834f7-66b1-42d4-8fa2-6f891951d386', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb60687e-a7ef-4aa4-848f-25bc8c4d3cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:12 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Volume volume-388834f7-66b1-42d4-8fa2-6f891951d386 (388834f7-66b1-42d4-8fa2-6f891951d386): created successfully Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb60687e-a7ef-4aa4-848f-25bc8c4d3cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Flow 'volume_create_manager' (cb9e3ef5-987a-475f-812b-f54a08ffc90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:12 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-dd946bc8-a964-4db1-a36d-535e12f11a79 tempest-VolumesTransfersTest-567443204 None] Created volume successfully. Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (cbca47d5-6a34-4a28-a19b-9c522543615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b5fb2a-674c-4920-b022-2fc200017e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b5fb2a-674c-4920-b022-2fc200017e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1625175457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b47b7c08-3b19-43cc-9e43-ef2e3012bdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:14Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020f9553-4dd4-48dc-91f8-33d65386429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020f9553-4dd4-48dc-91f8-33d65386429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8edc53-f6bc-4a51-b677-83b6f475cdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8edc53-f6bc-4a51-b677-83b6f475cdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b47b7c08-3b19-43cc-9e43-ef2e3012bdb5', 'volume_name': 'volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449a6c71-93b1-43c4-b1d6-612c10bd4f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449a6c71-93b1-43c4-b1d6-612c10bd4f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752df55f-d478-4864-a7c6-d8d805316d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:13 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Volume b47b7c08-3b19-43cc-9e43-ef2e3012bdb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5', 'volume_size': 1} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1625175457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b47b7c08-3b19-43cc-9e43-ef2e3012bdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5e7a945acd45d2b42bdfefab1bfaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:14Z,use_quota=True,user_id='b50c9a21299044a2a0586738e37aa995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Creating volume b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:30:13 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:30:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:14 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 1073741824 Sep 08 07:30:14 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:14 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 1073741824" returned: 0 in 0.552s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:14 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 Sep 08 07:30:14 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-140ba21c-4a3d-4961-bb98-81ad45c6f362 tempest-VolumesTransfersTest-908640499 None] Transfer volume completed successfully. Sep 08 07:30:14 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5" returned: 0 in 0.322s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:30:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752df55f-d478-4864-a7c6-d8d805316d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c85c552-e7de-4981-ace7-2d427b776178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:15 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Volume volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 (b47b7c08-3b19-43cc-9e43-ef2e3012bdb5): created successfully Sep 08 07:30:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c85c552-e7de-4981-ace7-2d427b776178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Flow 'volume_create_manager' (cbca47d5-6a34-4a28-a19b-9c522543615b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:15 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b2c7d44d-d3b4-4225-b7f0-81cffebaf2c6 tempest-VolumesActionsTest-1859912618 None] Created volume successfully. Sep 08 07:30:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Acquiring lock "cinder-388834f7-66b1-42d4-8fa2-6f891951d386-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Lock "cinder-388834f7-66b1-42d4-8fa2-6f891951d386-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Acquiring lock "cinder-quobyte-388834f7-66b1-42d4-8fa2-6f891951d386" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Lock "cinder-quobyte-388834f7-66b1-42d4-8fa2-6f891951d386" acquired by "delete_volume" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:15 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[456c872e-7c85-4e1c-87f2-4f19da5470c8]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:16 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386 Sep 08 07:30:16 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:16 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386" returned: 0 in 0.835s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:16 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386 Sep 08 07:30:16 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Acquiring lock "cinder-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:17 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-388834f7-66b1-42d4-8fa2-6f891951d386" returned: 0 in 0.393s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Lock "cinder-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Lock "cinder-quobyte-388834f7-66b1-42d4-8fa2-6f891951d386" released by "delete_volume" :: held 1.309s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Acquiring lock "cinder-quobyte-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-8f25e863-292e-45f1-bbf9-370da9aa40b2 req-9cf9d8cf-1ad6-4123-997d-798a97a94702 tempest-TestShelveInstance-163993526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-8f25e863-292e-45f1-bbf9-370da9aa40b2 req-9cf9d8cf-1ad6-4123-997d-798a97a94702 tempest-TestShelveInstance-163993526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Lock "cinder-quobyte-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5" acquired by "delete_volume" :: waited 0.041s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Created reservations ['77feb299-a8ef-49c8-8e6c-b715667f4e95', '07b281d8-fb8e-47d6-83f1-4af86f245bbb', 'fdcdf8ea-bfe9-4c5f-a80c-517bd1a145cc', '2d907506-f9df-461b-a88e-6f7e3e446bae'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-8f25e863-292e-45f1-bbf9-370da9aa40b2 req-9cf9d8cf-1ad6-4123-997d-798a97a94702 tempest-TestShelveInstance-163993526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d96fa1c-7741-4580-8aca-79713f173ad6]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-8f25e863-292e-45f1-bbf9-370da9aa40b2 req-9cf9d8cf-1ad6-4123-997d-798a97a94702 tempest-TestShelveInstance-163993526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3148c30-2872-412b-9633-06bf3b79bcec', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:30:17 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 Sep 08 07:30:17 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:17 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:17 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-8f25e863-292e-45f1-bbf9-370da9aa40b2 req-9cf9d8cf-1ad6-4123-997d-798a97a94702 tempest-TestShelveInstance-163993526 None] attachment_update completed successfully. Sep 08 07:30:17 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.291s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Deleted volume successfully. Sep 08 07:30:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-85137a09-7e4d-422f-af82-cf6d2ebe95b3 tempest-VolumesTransfersTest-1398784980 None] Lock "cinder-388834f7-66b1-42d4-8fa2-6f891951d386-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:18 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5" returned: 0 in 0.702s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:18 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5 Sep 08 07:30:18 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:18 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5" returned: 0 in 0.360s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Lock "cinder-quobyte-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5" released by "delete_volume" :: held 1.140s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Created reservations ['4b0e5292-b794-450c-b92d-132ba4371be7', '45e199c9-aac2-48a9-bcf4-ef35f57553f7', '5e67206b-5197-4180-9653-29483ad890ea', '130ebd3a-5d22-41eb-a44a-8c3700bc697b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:18 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:18 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:30:19 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Flow 'volume_create_manager' (86cb9aaf-fa9d-4292-8612-57cbea0d86bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837a6002-0a38-4dfa-9823-78771229f009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.372s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Deleted volume successfully. Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837a6002-0a38-4dfa-9823-78771229f009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1287357986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0a115c-f55e-4947-91ac-5db8c1093da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f808ddc6e13943569bdb831002756505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:19Z,use_quota=True,user_id='e6ed74daa3d94ec3bd4c5c981274060e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1171553-da25-43dc-a7e4-0ddb4dae83d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1171553-da25-43dc-a7e4-0ddb4dae83d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fbf09a-adb7-4b92-a71e-15198f20228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fbf09a-adb7-4b92-a71e-15198f20228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0a115c-f55e-4947-91ac-5db8c1093da0', 'volume_name': 'volume-2c0a115c-f55e-4947-91ac-5db8c1093da0', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c7f622-a386-4405-a6d1-eb42b26b6c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c7f622-a386-4405-a6d1-eb42b26b6c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a918ad-aa43-4fe7-9b03-c058bb300d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Volume 2c0a115c-f55e-4947-91ac-5db8c1093da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0a115c-f55e-4947-91ac-5db8c1093da0', 'volume_size': 1} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1287357986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0a115c-f55e-4947-91ac-5db8c1093da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f808ddc6e13943569bdb831002756505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:19Z,use_quota=True,user_id='e6ed74daa3d94ec3bd4c5c981274060e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Creating volume 2c0a115c-f55e-4947-91ac-5db8c1093da0 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:30:19 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:19 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 1073741824 Sep 08 07:30:19 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Flow 'volume_create_manager' (d5955588-f638-4102-bc8d-0e37721f8dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78540992-42dc-49cb-a3b4-4c9df4e6173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78540992-42dc-49cb-a3b4-4c9df4e6173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779076685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96aa2760-bd63-476a-93e2-419402985c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26b6755c4e74a9f8f2554ebb32fd603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:19Z,use_quota=True,user_id='dc0b6797fdf64ef3a7d3299d033d7b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd58b4a-d86e-4354-9fc9-5b4225337f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd58b4a-d86e-4354-9fc9-5b4225337f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ad845e-6b0b-4e73-aaf7-966ca58deda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ad845e-6b0b-4e73-aaf7-966ca58deda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96aa2760-bd63-476a-93e2-419402985c7b', 'volume_name': 'volume-96aa2760-bd63-476a-93e2-419402985c7b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fdc88f2-b987-499f-965a-0d56b57b3876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fdc88f2-b987-499f-965a-0d56b57b3876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e64269-4659-4aaf-b0a1-c0c7883e834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:19 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Volume 96aa2760-bd63-476a-93e2-419402985c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96aa2760-bd63-476a-93e2-419402985c7b', 'volume_size': 1} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5cdb15d4-63ad-4982-bbf5-50ef343a552d tempest-VolumesActionsTest-1859912618 None] Lock "cinder-b47b7c08-3b19-43cc-9e43-ef2e3012bdb5-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:19 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 1073741824" returned: 0 in 0.529s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:19 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 Sep 08 07:30:19 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:20 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0" returned: 0 in 0.307s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779076685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96aa2760-bd63-476a-93e2-419402985c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26b6755c4e74a9f8f2554ebb32fd603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:19Z,use_quota=True,user_id='dc0b6797fdf64ef3a7d3299d033d7b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Creating volume 96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:30:20 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a918ad-aa43-4fe7-9b03-c058bb300d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0a115c-f55e-4947-91ac-5db8c1093da0', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38e1a15-bfa7-4ba6-89b5-80fb520becf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:20 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b 1073741824 Sep 08 07:30:20 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:20 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Volume volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 (2c0a115c-f55e-4947-91ac-5db8c1093da0): created successfully Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38e1a15-bfa7-4ba6-89b5-80fb520becf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Flow 'volume_create_manager' (86cb9aaf-fa9d-4292-8612-57cbea0d86bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6a700301-ccba-4477-a089-454f02c05e03 tempest-VolumesTransfersTest-567443204 None] Created volume successfully. Sep 08 07:30:20 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b 1073741824" returned: 0 in 0.591s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:20 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b Sep 08 07:30:20 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:21 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b" returned: 0 in 0.277s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e64269-4659-4aaf-b0a1-c0c7883e834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96aa2760-bd63-476a-93e2-419402985c7b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3d13d8-7efb-4bb7-a1d5-fbb11f979945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:21 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Volume volume-96aa2760-bd63-476a-93e2-419402985c7b (96aa2760-bd63-476a-93e2-419402985c7b): created successfully Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3d13d8-7efb-4bb7-a1d5-fbb11f979945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Flow 'volume_create_manager' (d5955588-f638-4102-bc8d-0e37721f8dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:21 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f72b6100-cd92-408f-9b8c-d735dcb4914d tempest-VolumesActionsTest-1310366713 None] Created volume successfully. Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Acquiring lock "cinder-2c0a115c-f55e-4947-91ac-5db8c1093da0-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Lock "cinder-2c0a115c-f55e-4947-91ac-5db8c1093da0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Acquiring lock "cinder-quobyte-2c0a115c-f55e-4947-91ac-5db8c1093da0" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Lock "cinder-quobyte-2c0a115c-f55e-4947-91ac-5db8c1093da0" acquired by "delete_volume" :: waited 0.046s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3632f6-3394-4fe2-9561-223cb93fa02f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:21 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 Sep 08 07:30:21 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:22 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0" returned: 0 in 0.595s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:22 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0 Sep 08 07:30:22 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:22 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2c0a115c-f55e-4947-91ac-5db8c1093da0" returned: 0 in 0.463s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Lock "cinder-quobyte-2c0a115c-f55e-4947-91ac-5db8c1093da0" released by "delete_volume" :: held 1.178s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:22 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Created reservations ['731e3d2b-2cfc-40b7-bfa6-c4c6dde9308f', '7e81bf27-50fa-4dd9-a6e3-93aa24c36e32', '869bf630-a920-4aa7-8d9a-d1057aada83e', 'ebf0a3d7-d8d9-405e-a641-6789c2654f69'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:23 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:23 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:23 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.359s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:23 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:23 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Deleted volume successfully. Sep 08 07:30:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4c00ff12-3dbe-494b-b9e7-84d50eb88866 tempest-VolumesTransfersTest-1398784980 None] Lock "cinder-2c0a115c-f55e-4947-91ac-5db8c1093da0-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:33 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:INSERT=26,cinder:DELETE=6,cinder:UPDATE=66,cinder:SELECT=47 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:30:33 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:INSERT=25,cinder:UPDATE=92,cinder:SELECT=75,cinder:DELETE=8 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:30:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-551b3970-b76c-43a1-88f2-4aa15e0bb00c tempest-VolumesActionsTest-1310366713 None] Acquiring lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b" by "attach_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-551b3970-b76c-43a1-88f2-4aa15e0bb00c tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b" acquired by "attach_volume" :: waited 0.033s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-551b3970-b76c-43a1-88f2-4aa15e0bb00c tempest-VolumesActionsTest-1310366713 None] Attaching volume 96aa2760-bd63-476a-93e2-419402985c7b to instance 2fdf9e82-877f-4495-a660-2ec7e4171b95 at mountpoint /dev/vdb on host None. Sep 08 07:30:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-551b3970-b76c-43a1-88f2-4aa15e0bb00c tempest-VolumesActionsTest-1310366713 None] Attach volume completed successfully. Sep 08 07:30:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-551b3970-b76c-43a1-88f2-4aa15e0bb00c tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b" released by "attach_volume" :: held 0.206s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ba377006-8f2b-4cdc-b8ec-b2ed148d49bd tempest-VolumesActionsTest-1310366713 None] Acquiring lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b-detach_volume" by "detach_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ba377006-8f2b-4cdc-b8ec-b2ed148d49bd tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ba377006-8f2b-4cdc-b8ec-b2ed148d49bd tempest-VolumesActionsTest-1310366713 None] Detaching volume 96aa2760-bd63-476a-93e2-419402985c7b from instance 2fdf9e82-877f-4495-a660-2ec7e4171b95. Sep 08 07:30:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ba377006-8f2b-4cdc-b8ec-b2ed148d49bd tempest-VolumesActionsTest-1310366713 None] Detach volume completed successfully. Sep 08 07:30:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ba377006-8f2b-4cdc-b8ec-b2ed148d49bd tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Flow 'volume_create_manager' (e8c8b451-7df6-48a1-890f-860367872832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59c1db1-318c-4e21-8f1f-7f6d41f3242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59c1db1-318c-4e21-8f1f-7f6d41f3242a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1649841253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c664dd3e-b6b6-4eea-a78e-c12cfc920d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05c6fea356e4cd1af943cde056fceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:41Z,use_quota=True,user_id='8c1535cab51648c89fe77573a887ca70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191f59e1-616a-40c4-9216-b0363eb7400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191f59e1-616a-40c4-9216-b0363eb7400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cafd27-b28c-406e-bc86-c27e45b4cd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cafd27-b28c-406e-bc86-c27e45b4cd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c664dd3e-b6b6-4eea-a78e-c12cfc920d71', 'volume_name': 'volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb4be1b-729a-4896-a945-f4b227a622c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb4be1b-729a-4896-a945-f4b227a622c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c02396c-019c-4ad7-a5bb-82823a422fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:41 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Volume c664dd3e-b6b6-4eea-a78e-c12cfc920d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71', 'volume_size': 1} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1649841253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c664dd3e-b6b6-4eea-a78e-c12cfc920d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05c6fea356e4cd1af943cde056fceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:41Z,use_quota=True,user_id='8c1535cab51648c89fe77573a887ca70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Creating volume c664dd3e-b6b6-4eea-a78e-c12cfc920d71 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:30:41 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:30:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:41 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 1073741824 Sep 08 07:30:41 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:42 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 1073741824" returned: 0 in 0.602s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:42 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 Sep 08 07:30:42 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:42 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" returned: 0 in 0.289s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:30:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c02396c-019c-4ad7-a5bb-82823a422fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274eacb1-85fe-4287-bb63-e0e9cc1b066d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:42 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Volume volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 (c664dd3e-b6b6-4eea-a78e-c12cfc920d71): created successfully Sep 08 07:30:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274eacb1-85fe-4287-bb63-e0e9cc1b066d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Flow 'volume_create_manager' (e8c8b451-7df6-48a1-890f-860367872832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fb6d84b5-2c70-49ea-bfa1-8692f096e8c8 tempest-SnapshotMetadataTestJSON-1955951337 None] Created volume successfully. Sep 08 07:30:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Creating offline snapshot c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 of volume c664dd3e-b6b6-4eea-a78e-c12cfc920d71 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:30:43 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4c2802-a9f0-4916-8364-45d585cae898]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:43 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 Sep 08 07:30:43 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:44 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" returned: 0 in 0.455s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:44 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 1G Sep 08 07:30:44 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:44 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:44 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:44 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 1G" returned: 0 in 0.613s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:44 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 Sep 08 07:30:44 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:45 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.422s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:30:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:30:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:30:45 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:45 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 is being set with open permissions: ugo+rw Sep 08 07:30:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:45 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 Sep 08 07:30:45 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:45 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5" returned: 0 in 0.370s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:45 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.info Sep 08 07:30:45 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:46 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.info" returned: 0 in 0.405s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:46 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.info is being set with open permissions: ugo+rw Sep 08 07:30:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:46 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.info Sep 08 07:30:46 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:46 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.info" returned: 0 in 0.278s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:46 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e8f96c84-d575-4d88-a320-af956aae1dee tempest-SnapshotMetadataTestJSON-1955951337 None] Create snapshot completed successfully Sep 08 07:30:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Acquiring lock "cinder-c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Acquiring lock "cinder-quobyte-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-quobyte-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Acquiring lock "cinder-quobyte-c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-quobyte-c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Deleting offline snapshot c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 of volume c664dd3e-b6b6-4eea-a78e-c12cfc920d71 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] snapshot_file for this snap is: volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6003db15-65c2-49aa-832b-86b38fea945b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:48 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 Sep 08 07:30:48 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:48 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5" returned: 0 in 0.749s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dec6fe-1112-4bc7-9860-0d67e896570a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:49 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 Sep 08 07:30:49 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:49 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" returned: 0 in 0.802s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:49 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 Sep 08 07:30:49 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:50 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5" returned: 0 in 0.759s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:50 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5 Sep 08 07:30:50 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:51 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71.c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5" returned: 0 in 0.505s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-quobyte-c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5" released by "_delete_snapshot" :: held 3.044s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-quobyte-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" released by "delete_snapshot" :: held 3.077s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:51 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Created reservations ['d9e490a7-0f79-4661-9185-ea56bd3afba5', '701371f0-7669-47f3-a2b1-cabbb597e994', '43e452a7-5ac0-4a25-a7ba-049f2769379d', '51840974-8b0b-441f-8ce3-dd583040c591'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:51 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Delete snapshot completed successfully. Sep 08 07:30:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a7543bfb-2e7f-4d66-84d0-e4f4bd19acd6 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-c0d6aa30-b48c-4ab0-bda0-183cc1cc7ba5-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Acquiring lock "cinder-c664dd3e-b6b6-4eea-a78e-c12cfc920d71-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-c664dd3e-b6b6-4eea-a78e-c12cfc920d71-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Acquiring lock "cinder-quobyte-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-quobyte-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" acquired by "delete_volume" :: waited 0.042s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:52 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[23396758-27a0-46fc-9dae-a0b901ab5a92]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:30:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:53 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 Sep 08 07:30:53 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:53 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" returned: 0 in 0.573s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:53 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71 Sep 08 07:30:53 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:53 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" returned: 0 in 0.483s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-quobyte-c664dd3e-b6b6-4eea-a78e-c12cfc920d71" released by "delete_volume" :: held 1.154s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Created reservations ['e9b53ae4-5c89-4eaf-9309-ceb49c1f25f8', 'c3b437b9-76fd-4b90-a04f-449692bf21a5', '6cc2e1ea-e7b0-4047-916e-f1edffb9dcb2', '1f0340c9-45f8-4b17-87ba-9a62ea659964'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:54 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:30:54 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:30:54 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.454s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:30:54 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Deleted volume successfully. Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-593584d9-ab01-4246-844c-530c629dd037 tempest-SnapshotMetadataTestJSON-1955951337 None] Lock "cinder-c664dd3e-b6b6-4eea-a78e-c12cfc920d71-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ceb65ad8-a22b-4532-a7d2-f5c599bce5f2 tempest-VolumesActionsTest-1310366713 None] Acquiring lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b" by "attach_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ceb65ad8-a22b-4532-a7d2-f5c599bce5f2 tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b" acquired by "attach_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:55 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ceb65ad8-a22b-4532-a7d2-f5c599bce5f2 tempest-VolumesActionsTest-1310366713 None] Attaching volume 96aa2760-bd63-476a-93e2-419402985c7b to instance fc6d650b-9118-437a-a3fb-47a520e5564d at mountpoint /dev/vdb on host None. Sep 08 07:30:55 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ceb65ad8-a22b-4532-a7d2-f5c599bce5f2 tempest-VolumesActionsTest-1310366713 None] Attach volume completed successfully. Sep 08 07:30:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ceb65ad8-a22b-4532-a7d2-f5c599bce5f2 tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b" released by "attach_volume" :: held 0.206s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7cf5b633-7f5f-4824-94ec-7aa38dd3d85a tempest-VolumesActionsTest-1310366713 None] Acquiring lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b-detach_volume" by "detach_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:30:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7cf5b633-7f5f-4824-94ec-7aa38dd3d85a tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:30:55 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7cf5b633-7f5f-4824-94ec-7aa38dd3d85a tempest-VolumesActionsTest-1310366713 None] Detaching volume 96aa2760-bd63-476a-93e2-419402985c7b from instance fc6d650b-9118-437a-a3fb-47a520e5564d. Sep 08 07:30:55 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7cf5b633-7f5f-4824-94ec-7aa38dd3d85a tempest-VolumesActionsTest-1310366713 None] Detach volume completed successfully. Sep 08 07:30:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7cf5b633-7f5f-4824-94ec-7aa38dd3d85a tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:30:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-22337828-2d64-4c15-9bfc-ccb80cc5336f req-3256b9fd-7e8f-4062-99e8-488a7592188b tempest-TestShelveInstance-163993526 None] Terminate volume connection completed successfully. Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-22337828-2d64-4c15-9bfc-ccb80cc5336f req-3256b9fd-7e8f-4062-99e8-488a7592188b tempest-TestShelveInstance-163993526 None] Deleting attachment e3148c30-2872-412b-9633-06bf3b79bcec. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (c7e213c2-8174-4169-9fc6-f2c062d8eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278ce25a-6fe9-4407-9df1-7f837bab2f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278ce25a-6fe9-4407-9df1-7f837bab2f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1512878680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b829bb-7804-48d6-b092-8e791cc39aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef3691b919d402b828b8412354f1377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:59Z,use_quota=True,user_id='b9fefd36647f4a348bc8f7ccb1345f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a8198e-4547-48c6-9938-3df66956fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a8198e-4547-48c6-9938-3df66956fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1915dbc-40c5-4de9-8553-273dddc0e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1915dbc-40c5-4de9-8553-273dddc0e24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86b829bb-7804-48d6-b092-8e791cc39aa9', 'volume_name': 'volume-86b829bb-7804-48d6-b092-8e791cc39aa9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254cac3b-e1b2-4234-ac3f-610c2b2e60a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254cac3b-e1b2-4234-ac3f-610c2b2e60a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c29911-86b6-4923-a50f-667a621e6560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:30:59 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Volume 86b829bb-7804-48d6-b092-8e791cc39aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86b829bb-7804-48d6-b092-8e791cc39aa9', 'volume_size': 1} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1512878680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b829bb-7804-48d6-b092-8e791cc39aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef3691b919d402b828b8412354f1377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:30:59Z,use_quota=True,user_id='b9fefd36647f4a348bc8f7ccb1345f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Creating volume 86b829bb-7804-48d6-b092-8e791cc39aa9 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:30:59 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:30:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:30:59 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 1073741824 Sep 08 07:30:59 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:00 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 1073741824" returned: 0 in 0.544s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:00 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 Sep 08 07:31:00 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:00 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9" returned: 0 in 0.324s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:31:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c29911-86b6-4923-a50f-667a621e6560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86b829bb-7804-48d6-b092-8e791cc39aa9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b18194b-347b-4f41-9393-d95666317681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:00 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Volume volume-86b829bb-7804-48d6-b092-8e791cc39aa9 (86b829bb-7804-48d6-b092-8e791cc39aa9): created successfully Sep 08 07:31:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b18194b-347b-4f41-9393-d95666317681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (c7e213c2-8174-4169-9fc6-f2c062d8eec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:00 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2a17bc53-c454-421a-86c1-fda4476dd71c tempest-VolumesSnapshotTestJSON-1685562781 None] Created volume successfully. Sep 08 07:31:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Creating offline snapshot a1ec60be-1e36-4bcb-8bd5-f43917ab4543 of volume 86b829bb-7804-48d6-b092-8e791cc39aa9 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:31:02 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feff18a-6e92-4af8-aa4a-b14439200c8a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:02 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 Sep 08 07:31:02 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:02 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9" returned: 0 in 0.487s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:02 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 1G Sep 08 07:31:02 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-744930f6-3d59-470d-b412-09d67a975294 req-88ec34e7-f702-4157-89ee-519e6bff80c4 tempest-TestShelveInstance-163993526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:03 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 1G" returned: 0 in 0.509s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86b829bb-7804-48d6-b092-8e791cc39aa9 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:03 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86b829bb-7804-48d6-b092-8e791cc39aa9 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 Sep 08 07:31:03 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:03 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86b829bb-7804-48d6-b092-8e791cc39aa9 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543" returned: 0 in 0.344s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:03 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 is being set with open permissions: ugo+rw Sep 08 07:31:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:03 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 Sep 08 07:31:03 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:03 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543" returned: 0 in 0.266s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:03 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.info Sep 08 07:31:03 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:04 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.info" returned: 0 in 0.267s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:04 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.info is being set with open permissions: ugo+rw Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:04 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.info Sep 08 07:31:04 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Flow 'volume_create_manager' (fac448ce-46fe-4f77-a0a9-69384f991164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112e9831-69b5-453a-aa94-b87fca0aa054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112e9831-69b5-453a-aa94-b87fca0aa054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-666123396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fa04df-be4c-4162-8fd1-5f1db7b6b90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656eeca63d3941e5a217f24e01745de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:31:04Z,use_quota=True,user_id='c9611bf4da5f47999303d4bfaebe2bcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb2ff99-abd0-4f70-a048-aea674ff0f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb2ff99-abd0-4f70-a048-aea674ff0f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db67fca8-aef5-4bf0-a8ef-97c17fc5d1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db67fca8-aef5-4bf0-a8ef-97c17fc5d1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40fa04df-be4c-4162-8fd1-5f1db7b6b90a', 'volume_name': 'volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358a40af-2c9f-465b-ad52-4b0308211fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358a40af-2c9f-465b-ad52-4b0308211fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a4a1cd-41cf-44a9-9d23-af76f38abd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:04 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Volume 40fa04df-be4c-4162-8fd1-5f1db7b6b90a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a', 'volume_size': 1} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:04 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.info" returned: 0 in 0.244s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-744930f6-3d59-470d-b412-09d67a975294 req-88ec34e7-f702-4157-89ee-519e6bff80c4 tempest-TestShelveInstance-163993526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.243s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-744930f6-3d59-470d-b412-09d67a975294 req-88ec34e7-f702-4157-89ee-519e6bff80c4 tempest-TestShelveInstance-163993526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.990s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b9906f-2145-4d82-b548-692a425adba9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-744930f6-3d59-470d-b412-09d67a975294 req-88ec34e7-f702-4157-89ee-519e6bff80c4 tempest-TestShelveInstance-163993526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44e216b6-8dae-445b-be48-83bf1862462d', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:31:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5ede4864-1ebe-4a8d-beaf-08af51e2e586 tempest-VolumesSnapshotTestJSON-1685562781 None] Create snapshot completed successfully Sep 08 07:31:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-744930f6-3d59-470d-b412-09d67a975294 req-88ec34e7-f702-4157-89ee-519e6bff80c4 tempest-TestShelveInstance-163993526 None] attachment_update completed successfully. Sep 08 07:31:04 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b Sep 08 07:31:04 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:04 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b" returned: 0 in 0.398s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bcd697-107e-432c-8538-eb6ad73b2508]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:05 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b Sep 08 07:31:05 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:05 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b" returned: 0 in 0.417s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.2f36dc6d-6773-47be-8862-dbce202d841atxb_kqjk.img {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:05 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.2f36dc6d-6773-47be-8862-dbce202d841atxb_kqjk.img Sep 08 07:31:05 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-a1ec60be-1e36-4bcb-8bd5-f43917ab4543-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-a1ec60be-1e36-4bcb-8bd5-f43917ab4543-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-86b829bb-7804-48d6-b092-8e791cc39aa9" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-86b829bb-7804-48d6-b092-8e791cc39aa9" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-a1ec60be-1e36-4bcb-8bd5-f43917ab4543" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-a1ec60be-1e36-4bcb-8bd5-f43917ab4543" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Deleting offline snapshot a1ec60be-1e36-4bcb-8bd5-f43917ab4543 of volume 86b829bb-7804-48d6-b092-8e791cc39aa9 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] snapshot_file for this snap is: volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c612f8ca-913b-4c98-a341-42a05bd5418e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:06 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 Sep 08 07:31:06 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:07 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543" returned: 0 in 0.887s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86b829bb-7804-48d6-b092-8e791cc39aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:31:07 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef12067a-0022-4268-98b4-99ae16841acd]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:07 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 Sep 08 07:31:07 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:08 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9" returned: 0 in 0.811s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:08 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 Sep 08 07:31:08 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:09 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543" returned: 0 in 1.009s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:09 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543 Sep 08 07:31:09 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:09 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9.a1ec60be-1e36-4bcb-8bd5-f43917ab4543" returned: 0 in 0.491s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-a1ec60be-1e36-4bcb-8bd5-f43917ab4543" released by "_delete_snapshot" :: held 3.500s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-86b829bb-7804-48d6-b092-8e791cc39aa9" released by "delete_snapshot" :: held 3.571s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:10 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Created reservations ['c205c25e-4a5b-492d-9ddb-46e1e54ecb8e', '734372d3-e9be-46f8-bcc9-f6dd51f7d24a', '78b958f6-5c42-4cf5-9dcf-65397c8039e3', '8b7e00c2-fef5-4c8b-8c87-3cb66033bace'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:31:10 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Delete snapshot completed successfully. Sep 08 07:31:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ab244a96-12dc-4d6f-848f-d681d25e156f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-a1ec60be-1e36-4bcb-8bd5-f43917ab4543-delete_snapshot" released by "delete_snapshot" :: held 4.127s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:11 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.2f36dc6d-6773-47be-8862-dbce202d841atxb_kqjk.img" returned: 0 in 5.872s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:11 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd2cd2-88fa-4952-8068-fbb90cc87f07]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:11 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b Sep 08 07:31:11 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (02387db6-13d6-4cd4-a608-fc945a1b7e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c39acd-4c07-4ba9-b5e8-9cce1c14ecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c39acd-4c07-4ba9-b5e8-9cce1c14ecdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1897005569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfcf63a3-155b-4463-a91c-7eb0af47affa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef3691b919d402b828b8412354f1377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:31:12Z,use_quota=True,user_id='b9fefd36647f4a348bc8f7ccb1345f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966e98f6-730a-4406-b88b-b359585e9a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966e98f6-730a-4406-b88b-b359585e9a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d86a014-497f-48f4-bff0-7c4e8003266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d86a014-497f-48f4-bff0-7c4e8003266c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfcf63a3-155b-4463-a91c-7eb0af47affa', 'volume_name': 'volume-dfcf63a3-155b-4463-a91c-7eb0af47affa', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0585bb-2c75-42ec-86ac-b56f80a07d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0585bb-2c75-42ec-86ac-b56f80a07d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3511fe-fa8b-42fe-91b9-81d17b21dde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:12 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Volume dfcf63a3-155b-4463-a91c-7eb0af47affa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfcf63a3-155b-4463-a91c-7eb0af47affa', 'volume_size': 1} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:12 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b" returned: 0 in 0.980s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.2f36dc6d-6773-47be-8862-dbce202d841atxb_kqjk.img {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:31:12 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Converted 1024.00 MB image at 174.35 MB/s Sep 08 07:31:12 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] 2f36dc6d-6773-47be-8862-dbce202d841a was raw, no need to convert to raw {{(pid=87278) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 07:31:22 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=54,cinder:INSERT=7,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:31:24 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=61,cinder:INSERT=13,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.824s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Uploaded volume to glance image-id: 2f36dc6d-6773-47be-8862-dbce202d841a. {{(pid=87278) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.948s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-666123396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fa04df-be4c-4162-8fd1-5f1db7b6b90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656eeca63d3941e5a217f24e01745de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:31:04Z,use_quota=True,user_id='c9611bf4da5f47999303d4bfaebe2bcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Creating volume 40fa04df-be4c-4162-8fd1-5f1db7b6b90a {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:31:32 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:32 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a 1073741824 Sep 08 07:31:32 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-890ab8ac-9ec6-4d9e-983d-304f986ca633 tempest-VolumesActionsTest-1310366713 None] Copy volume to image completed successfully. Sep 08 07:31:32 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a 1073741824" returned: 0 in 0.429s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:32 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a Sep 08 07:31:32 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:33 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a" returned: 0 in 0.259s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.933s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1897005569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfcf63a3-155b-4463-a91c-7eb0af47affa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef3691b919d402b828b8412354f1377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:31:12Z,use_quota=True,user_id='b9fefd36647f4a348bc8f7ccb1345f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Creating volume dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:31:33 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a4a1cd-41cf-44a9-9d23-af76f38abd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:33 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa 1073741824 Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db596ee7-1870-460e-a086-ba9ba24578d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:33 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:33 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Volume volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a (40fa04df-be4c-4162-8fd1-5f1db7b6b90a): created successfully Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db596ee7-1870-460e-a086-ba9ba24578d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Flow 'volume_create_manager' (fac448ce-46fe-4f77-a0a9-69384f991164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:33 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-28a95bf6-9d6a-4ebd-b455-b0f20a0e831c tempest-VolumesTransfersV357Test-60152429 None] Created volume successfully. Sep 08 07:31:33 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa 1073741824" returned: 0 in 0.478s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:33 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa Sep 08 07:31:33 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:33 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa" returned: 0 in 0.307s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.135s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3511fe-fa8b-42fe-91b9-81d17b21dde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfcf63a3-155b-4463-a91c-7eb0af47affa', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cfc46c-fa32-49e5-98d7-a910d0709c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9531d729-357c-4595-8ad4-a79003809067]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:33 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Volume volume-dfcf63a3-155b-4463-a91c-7eb0af47affa (dfcf63a3-155b-4463-a91c-7eb0af47affa): created successfully Sep 08 07:31:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cfc46c-fa32-49e5-98d7-a910d0709c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (02387db6-13d6-4cd4-a608-fc945a1b7e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:34 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d2b309b4-2f8e-400a-93ef-20856124a801 tempest-VolumesSnapshotTestJSON-1685562781 None] Created volume successfully. Sep 08 07:31:34 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b Sep 08 07:31:34 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:34 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b" returned: 0 in 0.408s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:34 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[868aa2f1-8e25-4292-bd82-316958f842da]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:34 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b Sep 08 07:31:34 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:34 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bc8643b3-55dd-43ab-8aef-770016868754 tempest-VolumesTransfersV357Test-1240626911 None] Transfer volume completed successfully. Sep 08 07:31:34 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b" returned: 0 in 0.476s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:34 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img Sep 08 07:31:34 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Acquiring lock "cinder-40fa04df-be4c-4162-8fd1-5f1db7b6b90a-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Lock "cinder-40fa04df-be4c-4162-8fd1-5f1db7b6b90a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Acquiring lock "cinder-quobyte-40fa04df-be4c-4162-8fd1-5f1db7b6b90a" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Lock "cinder-quobyte-40fa04df-be4c-4162-8fd1-5f1db7b6b90a" acquired by "delete_volume" :: waited 0.051s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:35 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae02580-8378-4b1d-a95e-df6ba898aa80]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:35 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a Sep 08 07:31:35 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:36 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a" returned: 0 in 0.703s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:36 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a Sep 08 07:31:36 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:36 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-40fa04df-be4c-4162-8fd1-5f1db7b6b90a" returned: 0 in 0.562s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Lock "cinder-quobyte-40fa04df-be4c-4162-8fd1-5f1db7b6b90a" released by "delete_volume" :: held 1.398s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:37 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Created reservations ['23385f77-8b14-4143-97ae-c33a7fba89c7', '17340ec9-89ac-47e2-a055-7a90a6252a5a', 'e6c15a7e-d311-4e23-b60b-61074d795d8a', '268dc4a5-3a90-4759-987c-7a0b4f8048d6'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:31:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:37 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:31:37 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:38 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.756s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:31:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Deleted volume successfully. Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8ea2e847-ba14-4ef5-99d7-03352578d198 tempest-VolumesTransfersV357Test-656424366 None] Lock "cinder-40fa04df-be4c-4162-8fd1-5f1db7b6b90a-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Flow 'volume_create_manager' (474bc72b-aaeb-4403-a50c-4720642b1e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb56646-3bc9-4a7f-8d0d-14434ab9b7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb56646-3bc9-4a7f-8d0d-14434ab9b7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1150182580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2685bf-fb0e-41fe-af4c-f755d6596ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656eeca63d3941e5a217f24e01745de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:31:39Z,use_quota=True,user_id='c9611bf4da5f47999303d4bfaebe2bcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5369d335-a495-4a7b-ad8f-ca800f245bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5369d335-a495-4a7b-ad8f-ca800f245bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a82029-413c-47a6-ab4d-81c059e10e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a82029-413c-47a6-ab4d-81c059e10e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2685bf-fb0e-41fe-af4c-f755d6596ecf', 'volume_name': 'volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2717eb-7e32-482e-97d3-ead6340d04ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2717eb-7e32-482e-97d3-ead6340d04ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d353bc91-a6f8-4a35-9958-adeea240eed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:38 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Volume 1c2685bf-fb0e-41fe-af4c-f755d6596ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf', 'volume_size': 1} Sep 08 07:31:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:39 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img" returned: 0 in 5.031s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:39 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4457553-4940-4e09-af98-148eab20abcc]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:40 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b Sep 08 07:31:40 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:40 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b" returned: 0 in 0.524s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:40 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:31:40 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Converted 1024.00 MB image at 203.51 MB/s Sep 08 07:31:40 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] afdc5d1e-ef08-4a42-b07b-8727063c339f was raw, converting to qcow2 {{(pid=87278) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 08 07:31:40 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd7ea45-6e87-4f59-8f49-0c64ea768ead]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:40 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img Sep 08 07:31:40 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:40 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img" returned: 0 in 0.369s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:40 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img Sep 08 07:31:40 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:41 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img" returned: 1 in 0.347s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:31:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img /opt/stack/data/cinder/conversion/vol_upload_97w7sw0u {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:41 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img /opt/stack/data/cinder/conversion/vol_upload_97w7sw0u Sep 08 07:31:41 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:41 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img /opt/stack/data/cinder/conversion/vol_upload_97w7sw0u" returned: 0 in 0.252s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:41 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Image conversion details: src /opt/stack/data/cinder/conversion/96aa2760-bd63-476a-93e2-419402985c7b.temp_image.afdc5d1e-ef08-4a42-b07b-8727063c339fzyzsj3j1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_97w7sw0u {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:31:41 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 08 07:31:41 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d5593d-b2a1-4746-8ea7-2366df47c864]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_97w7sw0u {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:41 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_97w7sw0u Sep 08 07:31:41 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:41 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_97w7sw0u" returned: 0 in 0.320s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.028s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Uploaded volume to glance image-id: afdc5d1e-ef08-4a42-b07b-8727063c339f. {{(pid=87278) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 07:31:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.841s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Creating offline snapshot 0577f82b-e5ed-4d3f-abc9-8ea0340dbedb of volume dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:31:43 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d794f2de-259f-46f6-af19-bbdd2f6b0559 tempest-VolumesActionsTest-1310366713 None] Copy volume to image completed successfully. Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[866f05e7-f71c-44bc-bb2d-d0024fb24aee]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:43 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa Sep 08 07:31:43 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:43 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa" returned: 0 in 0.376s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:43 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb 1G Sep 08 07:31:43 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:43 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb 1G" returned: 0 in 0.408s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfcf63a3-155b-4463-a91c-7eb0af47affa -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:43 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfcf63a3-155b-4463-a91c-7eb0af47affa -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb Sep 08 07:31:43 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Acquiring lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Acquiring lock "cinder-quobyte-96aa2760-bd63-476a-93e2-419402985c7b" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Lock "cinder-quobyte-96aa2760-bd63-476a-93e2-419402985c7b" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1d1209-45c4-4da6-a847-5c1d4912a632]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:44 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfcf63a3-155b-4463-a91c-7eb0af47affa -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb" returned: 0 in 0.312s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:44 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb is being set with open permissions: ugo+rw Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:44 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b Sep 08 07:31:44 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:44 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb Sep 08 07:31:44 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:44 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb" returned: 0 in 0.251s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:44 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b" returned: 0 in 0.390s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:44 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.info Sep 08 07:31:44 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:44 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b Sep 08 07:31:44 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:44 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:44 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-96aa2760-bd63-476a-93e2-419402985c7b" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.info" returned: 0 in 0.294s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:44 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.info is being set with open permissions: ugo+rw Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:44 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:31:44 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Lock "cinder-quobyte-96aa2760-bd63-476a-93e2-419402985c7b" released by "delete_volume" :: held 0.716s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:44 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.info Sep 08 07:31:44 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Created reservations ['dfc1a789-dea0-4cf4-a0be-d08de211e6ef', '0efed7ff-dbde-4714-b12c-27b590641a9a', '9280a9ff-f74e-4011-92df-0916b7989053', '042cbc1b-1a79-45e1-a18c-d0e42788b7a7'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:44 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:31:44 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:44 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.249s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:31:44 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.info" returned: 0 in 0.273s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.989s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1150182580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2685bf-fb0e-41fe-af4c-f755d6596ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656eeca63d3941e5a217f24e01745de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:31:39Z,use_quota=True,user_id='c9611bf4da5f47999303d4bfaebe2bcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Creating volume 1c2685bf-fb0e-41fe-af4c-f755d6596ecf {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:31:45 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:45 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf 1073741824 Sep 08 07:31:45 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8e0bc81a-d1cb-4089-8343-6645d0d8f0aa tempest-VolumesSnapshotTestJSON-1685562781 None] Create snapshot completed successfully Sep 08 07:31:45 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.294s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:31:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Deleted volume successfully. Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-20d93c8b-0632-448c-ad79-684f28358bcd tempest-VolumesActionsTest-1310366713 None] Lock "cinder-96aa2760-bd63-476a-93e2-419402985c7b-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:45 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf 1073741824" returned: 0 in 0.485s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:45 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf Sep 08 07:31:45 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:45 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf" returned: 0 in 0.316s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d353bc91-a6f8-4a35-9958-adeea240eed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac02699f-f3de-4b80-ab9e-32d90389b0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:45 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Volume volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf (1c2685bf-fb0e-41fe-af4c-f755d6596ecf): created successfully Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac02699f-f3de-4b80-ab9e-32d90389b0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Flow 'volume_create_manager' (474bc72b-aaeb-4403-a50c-4720642b1e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8514975e-a89b-4380-907e-a84d62d3e291 tempest-VolumesTransfersV357Test-60152429 None] Created volume successfully. Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (d2c8f380-c39b-4883-be5e-9100314e1b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e133a35-4aae-42fd-90f5-a7eb78c1e25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e133a35-4aae-42fd-90f5-a7eb78c1e25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1838420535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd4df91-1f00-434c-a538-c29718f6ea53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef3691b919d402b828b8412354f1377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:31:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0577f82b-e5ed-4d3f-abc9-8ea0340dbedb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:31:46Z,use_quota=True,user_id='b9fefd36647f4a348bc8f7ccb1345f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25755554-c692-46a2-adda-c7fb7b0a5a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25755554-c692-46a2-adda-c7fb7b0a5a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb866f8-44d2-462c-89ff-d0f70fde0b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb866f8-44d2-462c-89ff-d0f70fde0b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3dd4df91-1f00-434c-a538-c29718f6ea53', 'volume_name': 'volume-3dd4df91-1f00-434c-a538-c29718f6ea53', 'volume_size': 2, 'snapshot_id': '0577f82b-e5ed-4d3f-abc9-8ea0340dbedb'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781300c0-e346-4611-8d83-9c00250cbada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781300c0-e346-4611-8d83-9c00250cbada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbe1de1-e803-49a9-9e83-4181f3ea8c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:46 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Volume 3dd4df91-1f00-434c-a538-c29718f6ea53: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3dd4df91-1f00-434c-a538-c29718f6ea53', 'volume_size': 2, 'snapshot_id': '0577f82b-e5ed-4d3f-abc9-8ea0340dbedb'} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-0577f82b-e5ed-4d3f-abc9-8ea0340dbedb-3dd4df91-1f00-434c-a538-c29718f6ea53" by "_create_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-0577f82b-e5ed-4d3f-abc9-8ea0340dbedb-3dd4df91-1f00-434c-a538-c29718f6ea53" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Creating volume 3dd4df91-1f00-434c-a538-c29718f6ea53 from snapshot 0577f82b-e5ed-4d3f-abc9-8ea0340dbedb {{(pid=87278) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-3dd4df91-1f00-434c-a538-c29718f6ea53" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-3dd4df91-1f00-434c-a538-c29718f6ea53" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] snapshot: 0577f82b-e5ed-4d3f-abc9-8ea0340dbedb, volume: 3dd4df91-1f00-434c-a538-c29718f6ea53, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2e395b-8b49-431f-b7b7-2261b98a7d9e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:46 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb Sep 08 07:31:46 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Acquiring lock "cinder-1c2685bf-fb0e-41fe-af4c-f755d6596ecf-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Lock "cinder-1c2685bf-fb0e-41fe-af4c-f755d6596ecf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Acquiring lock "cinder-quobyte-1c2685bf-fb0e-41fe-af4c-f755d6596ecf" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Lock "cinder-quobyte-1c2685bf-fb0e-41fe-af4c-f755d6596ecf" acquired by "delete_volume" :: waited 0.013s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ecb5e0-10f4-4de6-9a40-d11f17a15a05]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:46 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf Sep 08 07:31:46 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:46 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb" returned: 0 in 0.456s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfcf63a3-155b-4463-a91c-7eb0af47affa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0f8f1b-de94-48ef-9c28-9cc43135963f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:47 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa Sep 08 07:31:47 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:47 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf" returned: 0 in 0.412s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:47 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf Sep 08 07:31:47 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:47 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa" returned: 0 in 0.407s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:47 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 Sep 08 07:31:47 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:47 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1c2685bf-fb0e-41fe-af4c-f755d6596ecf" returned: 0 in 0.283s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Lock "cinder-quobyte-1c2685bf-fb0e-41fe-af4c-f755d6596ecf" released by "delete_volume" :: held 0.740s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Created reservations ['e954c73a-5fa3-4ef5-9df7-787f9c4c94fa', '6041d160-2353-4155-8902-01048b719c6d', 'ec6d0850-490b-486b-b857-2ba165c49049', '4ed7a2e1-9279-4bba-8b82-5cd7217ff119'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:47 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:31:47 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:48 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.430s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:48 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:31:48 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Deleted volume successfully. Sep 08 07:31:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-70326b75-9256-477f-a58c-e267e9c36e74 tempest-VolumesTransfersV357Test-656424366 None] Lock "cinder-1c2685bf-fb0e-41fe-af4c-f755d6596ecf-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:53 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53" returned: 0 in 6.218s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:31:53 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Converted 1024.00 MB image at 164.62 MB/s Sep 08 07:31:53 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 is being set with open permissions: ugo+rw Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:53 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 Sep 08 07:31:53 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:53 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53" returned: 0 in 0.318s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-3dd4df91-1f00-434c-a538-c29718f6ea53" released by "_copy_volume_from_snapshot" :: held 7.505s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-0577f82b-e5ed-4d3f-abc9-8ea0340dbedb-3dd4df91-1f00-434c-a538-c29718f6ea53" released by "_create_volume_from_snapshot" :: held 7.578s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.596s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbe1de1-e803-49a9-9e83-4181f3ea8c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd4df91-1f00-434c-a538-c29718f6ea53', 'volume_size': 2, 'snapshot_id': '0577f82b-e5ed-4d3f-abc9-8ea0340dbedb'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec459767-f505-4b4e-b632-e35b744f7dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:53 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Volume volume-3dd4df91-1f00-434c-a538-c29718f6ea53 (3dd4df91-1f00-434c-a538-c29718f6ea53): created successfully Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec459767-f505-4b4e-b632-e35b744f7dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (d2c8f380-c39b-4883-be5e-9100314e1b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:54 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8fb27d44-1f0a-4657-8913-842abed1adb4 tempest-VolumesSnapshotTestJSON-1685562781 None] Created volume successfully. Sep 08 07:31:54 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-9f1983f9-8125-455e-80f9-537ec0b8acce tempest-TestShelveInstance-163993526 None] Terminate volume connection completed successfully. Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-9f1983f9-8125-455e-80f9-537ec0b8acce tempest-TestShelveInstance-163993526 None] Deleting attachment 44e216b6-8dae-445b-be48-83bf1862462d. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-3dd4df91-1f00-434c-a538-c29718f6ea53-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-3dd4df91-1f00-434c-a538-c29718f6ea53-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-3dd4df91-1f00-434c-a538-c29718f6ea53" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-3dd4df91-1f00-434c-a538-c29718f6ea53" acquired by "delete_volume" :: waited 0.035s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a9697d-0440-40b8-866f-cadda5ac6ddc]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Acquiring lock "cinder-aee13909-6ef5-44ee-b49a-8a7288bb9c9e-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Lock "cinder-aee13909-6ef5-44ee-b49a-8a7288bb9c9e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:54 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 Sep 08 07:31:54 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Acquiring lock "cinder-quobyte-aee13909-6ef5-44ee-b49a-8a7288bb9c9e" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Lock "cinder-quobyte-aee13909-6ef5-44ee-b49a-8a7288bb9c9e" acquired by "delete_volume" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea712780-c237-4020-a536-cd0e52b59189]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:55 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e Sep 08 07:31:55 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:55 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53" returned: 0 in 0.675s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:55 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53 Sep 08 07:31:55 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:55 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e" returned: 0 in 0.572s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:55 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e Sep 08 07:31:55 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:55 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3dd4df91-1f00-434c-a538-c29718f6ea53" returned: 0 in 0.462s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-3dd4df91-1f00-434c-a538-c29718f6ea53" released by "delete_volume" :: held 1.203s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:55 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-aee13909-6ef5-44ee-b49a-8a7288bb9c9e" returned: 0 in 0.299s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Lock "cinder-quobyte-aee13909-6ef5-44ee-b49a-8a7288bb9c9e" released by "delete_volume" :: held 0.970s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Created reservations ['c77d92b2-de9f-49aa-8e40-5789be9cd425', '1ac8c425-a3dc-439c-afe1-d3f59e111767', '29555940-2bb3-4e5c-ad0f-1585ef74db0f', '2cbf4f74-d28a-4e1b-bcb9-43ee19a40898'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.quota [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Created reservations ['b06117f8-1cc5-4ecb-8754-bdb8c35c8438', 'f2a795d5-0bc8-48ae-88db-36921c8b8c6c', '18a5c84d-ef25-4227-92c9-5e3febc8cec5', 'ec805363-f2c0-437a-8645-5d0bcac8e249'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:56 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:31:56 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:56 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:31:56 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:56 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.353s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:31:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Deleted volume successfully. Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ea49940e-15a8-48c8-807d-2cf147e5587c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-3dd4df91-1f00-434c-a538-c29718f6ea53-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:56 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.334s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.manager [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:31:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Deleted volume successfully. Sep 08 07:31:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [req-9473dc3b-5278-4bc3-af36-18e3b79c4eee req-6aa248ab-82e1-40f2-a081-888e4bbb5170 tempest-TestShelveInstance-163993526 None] Lock "cinder-aee13909-6ef5-44ee-b49a-8a7288bb9c9e-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-0577f82b-e5ed-4d3f-abc9-8ea0340dbedb-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-0577f82b-e5ed-4d3f-abc9-8ea0340dbedb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-dfcf63a3-155b-4463-a91c-7eb0af47affa" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-dfcf63a3-155b-4463-a91c-7eb0af47affa" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-0577f82b-e5ed-4d3f-abc9-8ea0340dbedb" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-0577f82b-e5ed-4d3f-abc9-8ea0340dbedb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Deleting offline snapshot 0577f82b-e5ed-4d3f-abc9-8ea0340dbedb of volume dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] snapshot_file for this snap is: volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd902c6-e6cc-40f7-87a5-53803b4dd27e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:57 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb Sep 08 07:31:57 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:57 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb" returned: 0 in 0.493s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfcf63a3-155b-4463-a91c-7eb0af47affa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74f83be-7e4b-48a3-bc66-b4051de47113]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:31:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:57 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa Sep 08 07:31:57 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:58 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa" returned: 0 in 0.781s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:58 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb Sep 08 07:31:58 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Flow 'volume_create_manager' (3c0b969e-2f82-43d8-94e2-3b8b09da4acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3d22e6-3c58-4f92-99cc-5d01e7a2ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3d22e6-3c58-4f92-99cc-5d01e7a2ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1251566797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9acc0ff-7528-46b2-adbb-e93cdee2bb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e94fba835635439782716cbc6fd9d1d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:31:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:31:59Z,use_quota=True,user_id='65c8bb8c5be94ba395be700aca041eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9006a44-45b4-4724-bc82-b1cb643b5c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9006a44-45b4-4724-bc82-b1cb643b5c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f33d66e-b51a-445d-989b-d58fbcfeba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f33d66e-b51a-445d-989b-d58fbcfeba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9acc0ff-7528-46b2-adbb-e93cdee2bb9c', 'volume_name': 'volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c', 'volume_size': 2}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01fdbb6-6530-4c0c-8d24-3908ddad0032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01fdbb6-6530-4c0c-8d24-3908ddad0032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b54870f-d741-41b2-ad97-93420d201f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:58 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Volume e9acc0ff-7528-46b2-adbb-e93cdee2bb9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c', 'volume_size': 2} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1251566797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9acc0ff-7528-46b2-adbb-e93cdee2bb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e94fba835635439782716cbc6fd9d1d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:31:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:31:59Z,use_quota=True,user_id='65c8bb8c5be94ba395be700aca041eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Creating volume e9acc0ff-7528-46b2-adbb-e93cdee2bb9c {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:31:58 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:31:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c 2147483648 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:58 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c 2147483648 Sep 08 07:31:58 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:59 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb" returned: 0 in 0.487s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:59 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb Sep 08 07:31:59 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:59 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa.0577f82b-e5ed-4d3f-abc9-8ea0340dbedb" returned: 0 in 0.334s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:59 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c 2147483648" returned: 0 in 0.658s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-0577f82b-e5ed-4d3f-abc9-8ea0340dbedb" released by "_delete_snapshot" :: held 2.262s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-dfcf63a3-155b-4463-a91c-7eb0af47affa" released by "delete_snapshot" :: held 2.299s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:31:59 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c Sep 08 07:31:59 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Created reservations ['18573e0b-5d1d-4658-bfe1-98db2d0de975', '45ba47aa-aee3-4553-9dbc-0309ca978d29', '5c904536-fa10-4c00-b8a2-ab38b6a9a538', 'de9f2a76-95dd-4623-9e76-c883cb0e39fd'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:31:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Delete snapshot completed successfully. Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0902422a-69e1-49a8-b2fa-57040f56d362 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-0577f82b-e5ed-4d3f-abc9-8ea0340dbedb-delete_snapshot" released by "delete_snapshot" :: held 2.558s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:31:59 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b54870f-d741-41b2-ad97-93420d201f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c', 'volume_size': 2}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118e8e48-192b-4d0e-8983-e59dad6ff336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:31:59 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Volume volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c (e9acc0ff-7528-46b2-adbb-e93cdee2bb9c): created successfully Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118e8e48-192b-4d0e-8983-e59dad6ff336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:31:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Flow 'volume_create_manager' (3c0b969e-2f82-43d8-94e2-3b8b09da4acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:31:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8f80a96e-336a-432d-91e2-a863b5b25bb8 tempest-VolumesCloneNegativeTest-1344192103 None] Created volume successfully. Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-dfcf63a3-155b-4463-a91c-7eb0af47affa-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-dfcf63a3-155b-4463-a91c-7eb0af47affa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-dfcf63a3-155b-4463-a91c-7eb0af47affa" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-dfcf63a3-155b-4463-a91c-7eb0af47affa" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[095b6108-5362-4da0-a4a0-06cb8f970c8b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:00 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa Sep 08 07:32:00 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Flow 'volume_create_manager' (682e4c23-1b10-416e-8bb6-8d88b463ae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180406e9-d4e7-4b07-8b71-b6d7c3553416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Acquiring lock "cinder-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180406e9-d4e7-4b07-8b71-b6d7c3553416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-439918376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b94f05-5714-423b-9872-cba8cf8b1a72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='574577a7b9ba44fca3a01fac12cb1c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:01Z,use_quota=True,user_id='486b9b93d2304343a341cc64f71ae407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a94779-f4b7-45ef-8e04-0e4b64016e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a94779-f4b7-45ef-8e04-0e4b64016e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff66c8ab-80b4-4bae-91a2-fa6246a42069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff66c8ab-80b4-4bae-91a2-fa6246a42069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b94f05-5714-423b-9872-cba8cf8b1a72', 'volume_name': 'volume-05b94f05-5714-423b-9872-cba8cf8b1a72', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0040fbf8-8f09-4201-ae19-6542263ba99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0040fbf8-8f09-4201-ae19-6542263ba99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1e01dc-1a21-446b-a363-ac428bdc9048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:00 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Volume 05b94f05-5714-423b-9872-cba8cf8b1a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b94f05-5714-423b-9872-cba8cf8b1a72', 'volume_size': 1} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-439918376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b94f05-5714-423b-9872-cba8cf8b1a72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='574577a7b9ba44fca3a01fac12cb1c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:01Z,use_quota=True,user_id='486b9b93d2304343a341cc64f71ae407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Creating volume 05b94f05-5714-423b-9872-cba8cf8b1a72 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:00 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "cinder-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:00 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72 1073741824 Sep 08 07:32:00 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Acquiring lock "cinder-quobyte-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:01 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa" returned: 0 in 0.471s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "cinder-quobyte-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c" acquired by "delete_volume" :: waited 0.029s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:01 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa Sep 08 07:32:01 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8a024-62e3-411a-b537-26611c4ba01b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:01 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c Sep 08 07:32:01 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:01 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dfcf63a3-155b-4463-a91c-7eb0af47affa" returned: 0 in 0.359s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-dfcf63a3-155b-4463-a91c-7eb0af47affa" released by "delete_volume" :: held 0.898s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Created reservations ['a9c621ae-4764-43ae-9325-fb3bd66b7d5f', 'd0123f76-7549-4ca4-b6fa-2cdf29871919', '609cf627-b9c3-48d2-9b49-b374b5542ca9', 'af03b79a-ca1f-4ffd-813e-395c676daa01'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:01 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72 1073741824" returned: 0 in 0.641s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:01 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c" returned: 0 in 0.541s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:01 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:01 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:01 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c Sep 08 07:32:01 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:01 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72 Sep 08 07:32:01 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:01 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.353s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:01 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Deleted volume successfully. Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-edb7c606-3164-43e7-afcd-5a682a1fd7b6 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-dfcf63a3-155b-4463-a91c-7eb0af47affa-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:02 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c" returned: 0 in 0.408s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "cinder-quobyte-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c" released by "delete_volume" :: held 1.010s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:02 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72" returned: 0 in 0.401s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1e01dc-1a21-446b-a363-ac428bdc9048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b94f05-5714-423b-9872-cba8cf8b1a72', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3b27b1-7957-498f-9469-44be5857f59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:02 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Volume volume-05b94f05-5714-423b-9872-cba8cf8b1a72 (05b94f05-5714-423b-9872-cba8cf8b1a72): created successfully Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3b27b1-7957-498f-9469-44be5857f59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Flow 'volume_create_manager' (682e4c23-1b10-416e-8bb6-8d88b463ae0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:02 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a48a3394-ea3e-497f-aadd-ccd53bff55f0 tempest-VolumesListTestJSON-390094488 None] Created volume successfully. Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Created reservations ['b28e2e94-75fa-4c80-a68e-d8adccfb4adb', 'cc7bc057-dcfe-48ab-a722-3cd827edaa4e', '2ba8bfa9-a5db-4892-a686-3cc87125dd6c', '7fe4176a-00a1-4852-83e8-92529ab5e256'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:02 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:02 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (6ffcb96e-c71f-457d-b090-d6f6c4257745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c2c145-f3d1-45cf-9c60-f07e19ba0349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c2c145-f3d1-45cf-9c60-f07e19ba0349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1812866043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742f47ba-2528-4d9c-9d6d-53dda9044ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef3691b919d402b828b8412354f1377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:02Z,use_quota=True,user_id='b9fefd36647f4a348bc8f7ccb1345f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba77d40-1815-4182-a6c4-e6ff8737c025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba77d40-1815-4182-a6c4-e6ff8737c025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07265f67-3764-44a6-9d77-f6a63454a500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07265f67-3764-44a6-9d77-f6a63454a500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '742f47ba-2528-4d9c-9d6d-53dda9044ea7', 'volume_name': 'volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3331f0-c7fa-4f11-a2bb-7dda2564855c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3331f0-c7fa-4f11-a2bb-7dda2564855c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a1338b-82d5-4169-837d-1d28db593635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:02 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Volume 742f47ba-2528-4d9c-9d6d-53dda9044ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7', 'volume_size': 1} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1812866043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742f47ba-2528-4d9c-9d6d-53dda9044ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef3691b919d402b828b8412354f1377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:02Z,use_quota=True,user_id='b9fefd36647f4a348bc8f7ccb1345f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Creating volume 742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:02 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:02 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 1073741824 Sep 08 07:32:02 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:02 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:02 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Deleted volume successfully. Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f9040d38-a237-4729-8433-11a0df3c4358 tempest-VolumesCloneNegativeTest-1344192103 None] Lock "cinder-e9acc0ff-7528-46b2-adbb-e93cdee2bb9c-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:02 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 1073741824" returned: 0 in 0.520s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:03 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 Sep 08 07:32:03 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:03 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7" returned: 0 in 0.370s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a1338b-82d5-4169-837d-1d28db593635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7541e42c-098d-4453-8fcf-842b62f20eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:03 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Volume volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 (742f47ba-2528-4d9c-9d6d-53dda9044ea7): created successfully Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7541e42c-098d-4453-8fcf-842b62f20eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (6ffcb96e-c71f-457d-b090-d6f6c4257745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:03 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3f90e30b-fe48-4600-85c6-8f54ad90d503 tempest-VolumesSnapshotTestJSON-1685562781 None] Created volume successfully. Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Flow 'volume_create_manager' (c54b7c9c-1597-4d61-91ed-b674bc58cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219f366a-98f0-4417-a834-afb30b016cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219f366a-98f0-4417-a834-afb30b016cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-799478049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2962c2-ecb8-425c-8346-838fe516a9de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='574577a7b9ba44fca3a01fac12cb1c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:03Z,use_quota=True,user_id='486b9b93d2304343a341cc64f71ae407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155662df-6ba1-4e68-81dd-90e78c67a70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155662df-6ba1-4e68-81dd-90e78c67a70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b34b41-a41f-4b43-822e-939cff994494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b34b41-a41f-4b43-822e-939cff994494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff2962c2-ecb8-425c-8346-838fe516a9de', 'volume_name': 'volume-ff2962c2-ecb8-425c-8346-838fe516a9de', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae887c7-c825-4113-8068-18dc4cab92d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae887c7-c825-4113-8068-18dc4cab92d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e890bf-4eb8-422c-8d5f-40644e6b071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:03 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Volume ff2962c2-ecb8-425c-8346-838fe516a9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff2962c2-ecb8-425c-8346-838fe516a9de', 'volume_size': 1} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-799478049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2962c2-ecb8-425c-8346-838fe516a9de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='574577a7b9ba44fca3a01fac12cb1c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:03Z,use_quota=True,user_id='486b9b93d2304343a341cc64f71ae407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Creating volume ff2962c2-ecb8-425c-8346-838fe516a9de {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:03 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:03 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de 1073741824 Sep 08 07:32:03 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:04 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de 1073741824" returned: 0 in 0.481s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:04 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de Sep 08 07:32:04 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:04 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de" returned: 0 in 0.341s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e890bf-4eb8-422c-8d5f-40644e6b071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff2962c2-ecb8-425c-8346-838fe516a9de', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cf13ca-21b7-4a03-a608-29e280a4c776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:04 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Volume volume-ff2962c2-ecb8-425c-8346-838fe516a9de (ff2962c2-ecb8-425c-8346-838fe516a9de): created successfully Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cf13ca-21b7-4a03-a608-29e280a4c776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Flow 'volume_create_manager' (c54b7c9c-1597-4d61-91ed-b674bc58cf40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9a751e9d-1a1a-42ad-8c4e-caa82d6aa5b1 tempest-VolumesListTestJSON-390094488 None] Created volume successfully. Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Creating offline snapshot 22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 of volume 742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8283f25c-82fb-43c6-981b-3d6ded20ccee]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:04 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 Sep 08 07:32:04 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:05 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7" returned: 0 in 0.404s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:05 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 1G Sep 08 07:32:05 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:05 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 1G" returned: 0 in 0.499s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:05 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 Sep 08 07:32:05 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:06 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46" returned: 0 in 0.378s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:06 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 is being set with open permissions: ugo+rw Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:06 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 Sep 08 07:32:06 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Flow 'volume_create_manager' (d1a20068-47c7-448a-92dd-26cec151a847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af9cc52-ab7a-4106-a0b8-f408b352d0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af9cc52-ab7a-4106-a0b8-f408b352d0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1222061019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='574577a7b9ba44fca3a01fac12cb1c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:06Z,use_quota=True,user_id='486b9b93d2304343a341cc64f71ae407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838510cf-c232-4253-b4eb-78cab4593219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838510cf-c232-4253-b4eb-78cab4593219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03c8c9f-39d0-4e6e-b772-7e433a902ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:06 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03c8c9f-39d0-4e6e-b772-7e433a902ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e', 'volume_name': 'volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f07e901-2043-4f00-b826-b1f3ff7f8dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f07e901-2043-4f00-b826-b1f3ff7f8dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1951a827-193e-456e-baba-0988636c32bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:06 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Volume 3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e', 'volume_size': 1} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46" returned: 0 in 0.283s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:06 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.info Sep 08 07:32:06 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:06 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.info" returned: 0 in 0.260s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:06 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.info is being set with open permissions: ugo+rw Sep 08 07:32:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:06 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.info Sep 08 07:32:06 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:07 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.info" returned: 0 in 0.385s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1222061019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='574577a7b9ba44fca3a01fac12cb1c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:06Z,use_quota=True,user_id='486b9b93d2304343a341cc64f71ae407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Creating volume 3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:07 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:07 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-350d777a-f6dd-4e17-a604-fa235493b4e4 tempest-VolumesSnapshotTestJSON-1685562781 None] Create snapshot completed successfully Sep 08 07:32:07 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e 1073741824 Sep 08 07:32:07 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Flow 'volume_create_manager' (431ae2e7-3af4-4bed-9e72-aaf26094201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:07 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e49e20-caf9-4377-bb57-d911e6a004c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e 1073741824" returned: 0 in 0.561s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e49e20-caf9-4377-bb57-d911e6a004c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1335155643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0890bae-64fc-4c67-bcb8-4469f21a30af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='365cfbdab4c249c5b8e9d34b4dab301e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:08Z,use_quota=True,user_id='add71c677cd04fbcae191a97c4e90efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b0fa75-c00f-4e42-b24f-c11b95ffba79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b0fa75-c00f-4e42-b24f-c11b95ffba79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876c88ae-536c-4cf7-93db-744efa009847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876c88ae-536c-4cf7-93db-744efa009847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0890bae-64fc-4c67-bcb8-4469f21a30af', 'volume_name': 'volume-a0890bae-64fc-4c67-bcb8-4469f21a30af', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6401a0e-11d4-4df3-8a16-866c3d8e476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6401a0e-11d4-4df3-8a16-866c3d8e476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e56672-213e-436b-8bd7-9fc034facebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:07 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Volume a0890bae-64fc-4c67-bcb8-4469f21a30af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0890bae-64fc-4c67-bcb8-4469f21a30af', 'volume_size': 1} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:07 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e Sep 08 07:32:07 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:08 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e" returned: 0 in 0.338s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.386s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1335155643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0890bae-64fc-4c67-bcb8-4469f21a30af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='365cfbdab4c249c5b8e9d34b4dab301e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:08Z,use_quota=True,user_id='add71c677cd04fbcae191a97c4e90efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Creating volume a0890bae-64fc-4c67-bcb8-4469f21a30af {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:08 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1951a827-193e-456e-baba-0988636c32bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:08 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af 1073741824 Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0966e2-f7d1-4b7d-8136-a16608c35b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:08 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:08 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Volume volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e (3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e): created successfully Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0966e2-f7d1-4b7d-8136-a16608c35b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Flow 'volume_create_manager' (d1a20068-47c7-448a-92dd-26cec151a847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:08 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-18e35257-b02f-4c1c-bde5-79f876a92ab2 tempest-VolumesListTestJSON-390094488 None] Created volume successfully. Sep 08 07:32:08 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af 1073741824" returned: 0 in 0.622s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:08 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af Sep 08 07:32:08 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (c6952f36-39a2-4d25-9aee-eb5dddd1e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb91d3a6-fa1e-4443-aad1-1c296523aa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb91d3a6-fa1e-4443-aad1-1c296523aa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-382902136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d10ed8-fd3a-4474-9bd2-df5b12db5389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef3691b919d402b828b8412354f1377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=22b5f318-5ae0-4a9c-ad7b-ae3173a92d46,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:09Z,use_quota=True,user_id='b9fefd36647f4a348bc8f7ccb1345f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8f461d-3984-40c0-836a-71f2ee617f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8f461d-3984-40c0-836a-71f2ee617f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0122db-958d-4a41-a1c7-968a126092c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0122db-958d-4a41-a1c7-968a126092c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60d10ed8-fd3a-4474-9bd2-df5b12db5389', 'volume_name': 'volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389', 'volume_size': 1, 'snapshot_id': '22b5f318-5ae0-4a9c-ad7b-ae3173a92d46'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d7efaa-0e80-4002-94b9-a241312b5e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d7efaa-0e80-4002-94b9-a241312b5e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfbfbba-6357-49cf-b2e1-dad5904a84b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:08 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Volume 60d10ed8-fd3a-4474-9bd2-df5b12db5389: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389', 'volume_size': 1, 'snapshot_id': '22b5f318-5ae0-4a9c-ad7b-ae3173a92d46'} Sep 08 07:32:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:09 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af" returned: 0 in 0.286s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.148s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-22b5f318-5ae0-4a9c-ad7b-ae3173a92d46-60d10ed8-fd3a-4474-9bd2-df5b12db5389" by "_create_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e56672-213e-436b-8bd7-9fc034facebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0890bae-64fc-4c67-bcb8-4469f21a30af', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8810538-8bd7-4b21-8cb1-65d0b38f4ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:09 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Volume volume-a0890bae-64fc-4c67-bcb8-4469f21a30af (a0890bae-64fc-4c67-bcb8-4469f21a30af): created successfully Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8810538-8bd7-4b21-8cb1-65d0b38f4ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Flow 'volume_create_manager' (431ae2e7-3af4-4bed-9e72-aaf26094201f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-22b5f318-5ae0-4a9c-ad7b-ae3173a92d46-60d10ed8-fd3a-4474-9bd2-df5b12db5389" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Creating volume 60d10ed8-fd3a-4474-9bd2-df5b12db5389 from snapshot 22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 {{(pid=87278) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-60d10ed8-fd3a-4474-9bd2-df5b12db5389" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:09 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a57ab2f6-e014-42b7-8e15-91c6bcae1e52 tempest-VolumesNegativeTest-1085391171 None] Created volume successfully. Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-60d10ed8-fd3a-4474-9bd2-df5b12db5389" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] snapshot: 22b5f318-5ae0-4a9c-ad7b-ae3173a92d46, volume: 60d10ed8-fd3a-4474-9bd2-df5b12db5389, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[622a7e0a-6979-4487-a151-20451af69241]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:09 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 Sep 08 07:32:09 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:09 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46" returned: 0 in 0.481s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb7b0d9-f7c3-4afc-9ea5-d9057f7d141e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:09 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 Sep 08 07:32:09 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:10 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7" returned: 0 in 0.505s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:32:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:32:10 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:32:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:10 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 Sep 08 07:32:10 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "cinder-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Lock "cinder-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "cinder-quobyte-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Lock "cinder-quobyte-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e" acquired by "delete_volume" :: waited 0.046s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:11 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e14e71-66af-4cca-98d5-3be375d68939]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:12 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e Sep 08 07:32:12 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:12 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e" returned: 0 in 1.126s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:12 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e Sep 08 07:32:12 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:13 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e" returned: 0 in 0.446s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Lock "cinder-quobyte-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e" released by "delete_volume" :: held 1.759s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:13 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Created reservations ['dc34fc05-981f-4c7e-a071-69180ea66fab', 'b84e5294-af51-4be5-8e38-01fbf1be3f95', '78935a06-80af-4615-a874-c03d3c657c1f', '0e7d7102-d024-422e-8851-0d09a8f96c7d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:14 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:14 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "cinder-ff2962c2-ecb8-425c-8346-838fe516a9de-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Lock "cinder-ff2962c2-ecb8-425c-8346-838fe516a9de-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "cinder-quobyte-ff2962c2-ecb8-425c-8346-838fe516a9de" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Lock "cinder-quobyte-ff2962c2-ecb8-425c-8346-838fe516a9de" acquired by "delete_volume" :: waited 0.056s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:14 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84430f7-f8f4-4d5d-8994-62ba17b30f58]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:14 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.748s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:14 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Deleted volume successfully. Sep 08 07:32:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4d0daf37-1d89-4062-8b88-c9afb711d5b4 tempest-VolumesListTestJSON-390094488 None] Lock "cinder-3fcdb2bf-abcc-46e3-b2d7-db6e2e3e832e-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:14 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de Sep 08 07:32:14 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:15 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de" returned: 0 in 1.198s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:15 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de Sep 08 07:32:15 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (a414f9dd-12e3-4ba0-a8ba-97b966547057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446cd500-7bd0-42f5-9615-9e3852075965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446cd500-7bd0-42f5-9615-9e3852075965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1222903221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f1abb9-b3d2-4239-8f7b-f6ccf7c46793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:16Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c79cb9-d7b3-4362-bfc3-2af7cac2bca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c79cb9-d7b3-4362-bfc3-2af7cac2bca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846732f9-997f-4e44-a4fa-f1f5e8cc8442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846732f9-997f-4e44-a4fa-f1f5e8cc8442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f1abb9-b3d2-4239-8f7b-f6ccf7c46793', 'volume_name': 'volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b02de3-2f22-4da3-8e3b-71046bc86415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b02de3-2f22-4da3-8e3b-71046bc86415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a23105-93bf-46d1-952a-90119908a724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Volume 58f1abb9-b3d2-4239-8f7b-f6ccf7c46793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793', 'volume_size': 1} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:16 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ff2962c2-ecb8-425c-8346-838fe516a9de" returned: 0 in 1.009s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:16 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Lock "cinder-quobyte-ff2962c2-ecb8-425c-8346-838fe516a9de" released by "delete_volume" :: held 2.388s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Created reservations ['7b485ffc-148b-47fb-bd1b-f6b9c1dec7a3', '778187c4-260b-4e1f-aac9-fb38f6e90b41', '121461a1-74c9-471d-8537-40f70e43cc5c', 'e131dc38-1c63-44e9-8c47-abeb115be30e'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:17 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:17 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:17 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (92846a3d-afe7-4b37-896b-96c1fd93a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729ae4b9-0a2e-4c24-b94e-4b40e152a8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729ae4b9-0a2e-4c24-b94e-4b40e152a8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-610881396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:17Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccee9ce4-ed03-4b96-a5c6-220eef3f55d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccee9ce4-ed03-4b96-a5c6-220eef3f55d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c01fcf-bd00-443d-91c1-45fb574d7142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c01fcf-bd00-443d-91c1-45fb574d7142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a', 'volume_name': 'volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300cb193-fa19-4499-a33c-a75361d9114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300cb193-fa19-4499-a33c-a75361d9114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12301054-e0e1-411f-acfb-13c28ca70254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Volume ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a', 'volume_size': 1} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389" returned: 0 in 7.362s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:32:17 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Converted 1024.00 MB image at 139.06 MB/s Sep 08 07:32:17 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 is being set with open permissions: ugo+rw Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:17 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 Sep 08 07:32:17 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:17 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.381s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Deleted volume successfully. Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f4958adc-3766-43e0-803d-530f686b0668 tempest-VolumesListTestJSON-390094488 None] Lock "cinder-ff2962c2-ecb8-425c-8346-838fe516a9de-delete_volume" released by "delete_volume" :: held 3.407s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:17 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389" returned: 0 in 0.339s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-60d10ed8-fd3a-4474-9bd2-df5b12db5389" released by "_copy_volume_from_snapshot" :: held 8.789s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (c644fa5d-8c78-44aa-978c-6253083591c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9739b7ae-00d8-4bf8-bf61-a4ce7105dcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-22b5f318-5ae0-4a9c-ad7b-ae3173a92d46-60d10ed8-fd3a-4474-9bd2-df5b12db5389" released by "_create_volume_from_snapshot" :: held 8.968s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.017s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1222903221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f1abb9-b3d2-4239-8f7b-f6ccf7c46793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:16Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Creating volume 58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:18 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:18 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 1073741824 Sep 08 07:32:18 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9739b7ae-00d8-4bf8-bf61-a4ce7105dcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1817565276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8e7c8c-aee0-474b-9617-6b124740901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:18Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286ee30e-3a82-4ad8-8de6-a1c2316dbc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286ee30e-3a82-4ad8-8de6-a1c2316dbc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13c5fed-55b0-43da-af1c-2dc0116148fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13c5fed-55b0-43da-af1c-2dc0116148fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e8e7c8c-aee0-474b-9617-6b124740901e', 'volume_name': 'volume-4e8e7c8c-aee0-474b-9617-6b124740901e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392eb555-aba7-4bcf-85ea-18433ee4c140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392eb555-aba7-4bcf-85ea-18433ee4c140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a117197-20b3-47dc-97b9-92d04e7db356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Volume 4e8e7c8c-aee0-474b-9617-6b124740901e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e8e7c8c-aee0-474b-9617-6b124740901e', 'volume_size': 1} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Acquiring lock "cinder-05b94f05-5714-423b-9872-cba8cf8b1a72-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfbfbba-6357-49cf-b2e1-dad5904a84b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389', 'volume_size': 1, 'snapshot_id': '22b5f318-5ae0-4a9c-ad7b-ae3173a92d46'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a0c7ac-7342-4291-86ee-e4e8042c738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Lock "cinder-05b94f05-5714-423b-9872-cba8cf8b1a72-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:18 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Volume volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 (60d10ed8-fd3a-4474-9bd2-df5b12db5389): created successfully Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a0c7ac-7342-4291-86ee-e4e8042c738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Flow 'volume_create_manager' (c6952f36-39a2-4d25-9aee-eb5dddd1e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Acquiring lock "cinder-quobyte-05b94f05-5714-423b-9872-cba8cf8b1a72" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:18 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b34eeda6-6b38-48f1-ab72-cfa71a93adce tempest-VolumesSnapshotTestJSON-1685562781 None] Created volume successfully. Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Lock "cinder-quobyte-05b94f05-5714-423b-9872-cba8cf8b1a72" acquired by "delete_volume" :: waited 0.033s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35adcc0-ac2b-45e7-91a2-9751c909fe01]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (815027b5-f661-45c7-9981-1772e942333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a8310e-5849-48ce-85dd-f814efafb285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a8310e-5849-48ce-85dd-f814efafb285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-397600733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3de9a0-664c-4de3-ae84-89c7f9a0dfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:18Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42379df6-de85-4bb8-a232-b29cb7d1e79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42379df6-de85-4bb8-a232-b29cb7d1e79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abae8b8-2b69-441c-a612-736e7ed32d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abae8b8-2b69-441c-a612-736e7ed32d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3de9a0-664c-4de3-ae84-89c7f9a0dfee', 'volume_name': 'volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f67134-444c-429f-a018-137df1cfa941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f67134-444c-429f-a018-137df1cfa941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2ebf75-5408-4090-8ab4-99e41e735c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:18 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Volume 9a3de9a0-664c-4de3-ae84-89c7f9a0dfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee', 'volume_size': 1} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:18 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72 Sep 08 07:32:18 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:18 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 1073741824" returned: 0 in 0.816s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:19 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 Sep 08 07:32:19 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:19 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (ca32045d-39bf-4162-bd37-0b07ddcea535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca23f3c9-0229-411d-95bd-7a9cc05e5873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72" returned: 0 in 0.659s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca23f3c9-0229-411d-95bd-7a9cc05e5873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897623426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db48b519-2962-46ec-aae2-34fdcb77391c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:19Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:19 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72 Sep 08 07:32:19 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f16a314-f09b-4af5-bd79-e77be660b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f16a314-f09b-4af5-bd79-e77be660b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69405ed7-6d0d-45b5-8c26-22688f335cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69405ed7-6d0d-45b5-8c26-22688f335cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db48b519-2962-46ec-aae2-34fdcb77391c', 'volume_name': 'volume-db48b519-2962-46ec-aae2-34fdcb77391c', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950a412a-5105-4ea4-ba52-a6f6ae02490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950a412a-5105-4ea4-ba52-a6f6ae02490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76865c5-9ee2-483b-b746-9bb90060dd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:19 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Volume db48b519-2962-46ec-aae2-34fdcb77391c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db48b519-2962-46ec-aae2-34fdcb77391c', 'volume_size': 1} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:19 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793" returned: 0 in 0.317s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-610881396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:17Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Creating volume ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:19 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a23105-93bf-46d1-952a-90119908a724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f05184a-64f2-469a-817e-7ab46b845efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:19 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a 1073741824 Sep 08 07:32:19 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:19 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Volume volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 (58f1abb9-b3d2-4239-8f7b-f6ccf7c46793): created successfully Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f05184a-64f2-469a-817e-7ab46b845efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (a414f9dd-12e3-4ba0-a8ba-97b966547057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2fe961b7-328c-43c1-8f7b-4d37e631b41a tempest-CreateVolumesFromImageTest-273486602 None] Created volume successfully. Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-60d10ed8-fd3a-4474-9bd2-df5b12db5389-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-60d10ed8-fd3a-4474-9bd2-df5b12db5389-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:19 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-05b94f05-5714-423b-9872-cba8cf8b1a72" returned: 0 in 0.403s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Lock "cinder-quobyte-05b94f05-5714-423b-9872-cba8cf8b1a72" released by "delete_volume" :: held 1.129s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-60d10ed8-fd3a-4474-9bd2-df5b12db5389" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-60d10ed8-fd3a-4474-9bd2-df5b12db5389" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[469630a8-2904-45c6-b028-9ce3b7d32cd4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Created reservations ['be837d7c-7cf7-494e-9185-910dd1875da4', '31d95ff7-cc67-42cb-a3ca-5ee37cf0c69f', '4a53a941-7fc3-4748-94a5-a689df50ba39', '178b211e-a187-4c9e-8425-f50a3751e35d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:19 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:19 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:19 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 Sep 08 07:32:19 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:20 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a 1073741824" returned: 0 in 0.771s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:20 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a Sep 08 07:32:20 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:20 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.402s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Deleted volume successfully. Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ab3e9a-fde2-4c6c-a9cb-53b81af8bc6f tempest-VolumesListTestJSON-390094488 None] Lock "cinder-05b94f05-5714-423b-9872-cba8cf8b1a72-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:20 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389" returned: 0 in 0.675s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:20 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389 Sep 08 07:32:20 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:20 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a" returned: 0 in 0.332s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.224s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1817565276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8e7c8c-aee0-474b-9617-6b124740901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:18Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Creating volume 4e8e7c8c-aee0-474b-9617-6b124740901e {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:20 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:20 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e 1073741824 Sep 08 07:32:20 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12301054-e0e1-411f-acfb-13c28ca70254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb5107a-4da0-403c-8ec5-cd17c2b0ceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:20 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Volume volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a (ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a): created successfully Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb5107a-4da0-403c-8ec5-cd17c2b0ceac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (92846a3d-afe7-4b37-896b-96c1fd93a60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f5ca1582-a8c1-4ec1-9caf-de6f1fba9e05 tempest-CreateVolumesFromImageTest-273486602 None] Created volume successfully. Sep 08 07:32:20 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-60d10ed8-fd3a-4474-9bd2-df5b12db5389" returned: 0 in 0.587s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-60d10ed8-fd3a-4474-9bd2-df5b12db5389" released by "delete_volume" :: held 1.361s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Created reservations ['2e8f3b44-3b87-44b2-8aae-660fbb13bd5a', 'a88f4c23-ba6e-42b3-b2be-9eb0d6a5d0f9', '1094590f-7858-412a-aacb-bfe3d82eb045', '4a436921-015c-4d1b-b320-4cd3adfbaebb'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:21 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:21 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:21 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e 1073741824" returned: 0 in 1.205s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:21 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.608s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:21 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:21 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e Sep 08 07:32:21 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:21 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Deleted volume successfully. Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a67b6afc-71f6-49de-94c6-42b2df38255c tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-60d10ed8-fd3a-4474-9bd2-df5b12db5389-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-22b5f318-5ae0-4a9c-ad7b-ae3173a92d46-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-22b5f318-5ae0-4a9c-ad7b-ae3173a92d46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-742f47ba-2528-4d9c-9d6d-53dda9044ea7" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-742f47ba-2528-4d9c-9d6d-53dda9044ea7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-22b5f318-5ae0-4a9c-ad7b-ae3173a92d46" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-22b5f318-5ae0-4a9c-ad7b-ae3173a92d46" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Deleting offline snapshot 22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 of volume 742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] snapshot_file for this snap is: volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b366375-907a-42a0-9fd7-8a8013296858]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:22 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e" returned: 0 in 0.611s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.747s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-397600733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3de9a0-664c-4de3-ae84-89c7f9a0dfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:18Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Creating volume 9a3de9a0-664c-4de3-ae84-89c7f9a0dfee {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:22 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:22 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee 1073741824 Sep 08 07:32:22 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a117197-20b3-47dc-97b9-92d04e7db356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8e7c8c-aee0-474b-9617-6b124740901e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6984ec5a-ecd6-4e2f-9d90-7b59d9c974ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:22 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 Sep 08 07:32:22 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:22 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Volume volume-4e8e7c8c-aee0-474b-9617-6b124740901e (4e8e7c8c-aee0-474b-9617-6b124740901e): created successfully Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6984ec5a-ecd6-4e2f-9d90-7b59d9c974ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (c644fa5d-8c78-44aa-978c-6253083591c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8b6bb6d6-785c-42fe-9cbc-e083aed02809 tempest-CreateVolumesFromImageTest-273486602 None] Created volume successfully. Sep 08 07:32:23 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46" returned: 0 in 0.682s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f6d58-890c-42e8-a4d7-b11c7b948a74]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:23 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee 1073741824" returned: 0 in 0.704s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:23 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee Sep 08 07:32:23 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:23 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 Sep 08 07:32:23 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:23 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee" returned: 0 in 0.499s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.538s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897623426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db48b519-2962-46ec-aae2-34fdcb77391c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c037c2c0a04d44579c603ed9d653c4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:19Z,use_quota=True,user_id='af14be020bc64aef970bc5d50b9c004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Creating volume db48b519-2962-46ec-aae2-34fdcb77391c {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:23 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2ebf75-5408-4090-8ab4-99e41e735c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:23 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c 1073741824 Sep 08 07:32:23 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed438159-9740-492f-ad63-f67e345f69a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Volume volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee (9a3de9a0-664c-4de3-ae84-89c7f9a0dfee): created successfully Sep 08 07:32:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed438159-9740-492f-ad63-f67e345f69a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (815027b5-f661-45c7-9981-1772e942333e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:24 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d97929ab-ae3a-4615-b5d5-ed155694a9c8 tempest-CreateVolumesFromImageTest-273486602 None] Created volume successfully. Sep 08 07:32:24 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7" returned: 0 in 0.948s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:24 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 Sep 08 07:32:24 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:24 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c 1073741824" returned: 0 in 0.976s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:24 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=135,cinder:SELECT=102,cinder:INSERT=33,cinder:DELETE=17 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:32:24 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46" returned: 0 in 0.783s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:24 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46 Sep 08 07:32:24 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:24 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c Sep 08 07:32:24 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:25 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7.22b5f318-5ae0-4a9c-ad7b-ae3173a92d46" returned: 0 in 0.378s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:25 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c" returned: 0 in 0.406s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-22b5f318-5ae0-4a9c-ad7b-ae3173a92d46" released by "_delete_snapshot" :: held 2.960s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76865c5-9ee2-483b-b746-9bb90060dd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db48b519-2962-46ec-aae2-34fdcb77391c', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ab5ef8-ea85-4cdf-b600-120a399ddac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-742f47ba-2528-4d9c-9d6d-53dda9044ea7" released by "delete_snapshot" :: held 3.020s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:25 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Volume volume-db48b519-2962-46ec-aae2-34fdcb77391c (db48b519-2962-46ec-aae2-34fdcb77391c): created successfully Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ab5ef8-ea85-4cdf-b600-120a399ddac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Flow 'volume_create_manager' (ca32045d-39bf-4162-bd37-0b07ddcea535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:25 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5a91d73d-b625-421b-838e-6cba1904dc6b tempest-CreateVolumesFromImageTest-273486602 None] Created volume successfully. Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Created reservations ['584d96ba-368e-43dc-810e-664df17cc17a', '0a9bf2f3-0655-4f1b-9fdb-5a1413617c04', '1d981495-8aee-4c93-8b46-1973860a94fe', '914a9a02-3b32-401b-8650-0271e75f4aee'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:25 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Delete snapshot completed successfully. Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e1ea349a-824a-4b87-9068-504238334df9 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-22b5f318-5ae0-4a9c-ad7b-ae3173a92d46-delete_snapshot" released by "delete_snapshot" :: held 3.276s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-742f47ba-2528-4d9c-9d6d-53dda9044ea7-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-742f47ba-2528-4d9c-9d6d-53dda9044ea7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-742f47ba-2528-4d9c-9d6d-53dda9044ea7" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-742f47ba-2528-4d9c-9d6d-53dda9044ea7" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8326da07-500b-4f58-b617-b0ef1b6802f3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:26 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 Sep 08 07:32:26 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-db48b519-2962-46ec-aae2-34fdcb77391c-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-db48b519-2962-46ec-aae2-34fdcb77391c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-quobyte-db48b519-2962-46ec-aae2-34fdcb77391c" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-db48b519-2962-46ec-aae2-34fdcb77391c" acquired by "delete_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:26 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7" returned: 0 in 0.496s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31461ee-d539-4a5e-b8c7-ec288bf7fc69]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:26 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7 Sep 08 07:32:26 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:26 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c Sep 08 07:32:26 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:26 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-742f47ba-2528-4d9c-9d6d-53dda9044ea7" returned: 0 in 0.312s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-742f47ba-2528-4d9c-9d6d-53dda9044ea7" released by "delete_volume" :: held 0.901s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Created reservations ['8c2923ac-e57b-4eb5-b8c4-24f3d1ee8eef', '74cdaf43-86f1-417f-9a9f-b42ee76e5ae6', '9aa60df7-928e-4ecf-a87c-26fdba781bfa', '77613f5b-b56a-4edd-8ca8-b4c20810b1cc'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:26 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c" returned: 0 in 0.421s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:26 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c Sep 08 07:32:26 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:26 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:26 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-86b829bb-7804-48d6-b092-8e791cc39aa9-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-86b829bb-7804-48d6-b092-8e791cc39aa9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "cinder-quobyte-86b829bb-7804-48d6-b092-8e791cc39aa9" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-86b829bb-7804-48d6-b092-8e791cc39aa9" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[692201c2-964d-4b05-b9da-78e6b98a9672]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:27 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-db48b519-2962-46ec-aae2-34fdcb77391c" returned: 0 in 0.461s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-db48b519-2962-46ec-aae2-34fdcb77391c" released by "delete_volume" :: held 0.957s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:27 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 Sep 08 07:32:27 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:27 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.424s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Deleted volume successfully. Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2019cc0f-18eb-493e-a379-17162bb2a31f tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-742f47ba-2528-4d9c-9d6d-53dda9044ea7-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Created reservations ['3a95a2a1-f43f-4957-be1a-8c017260158e', '0d408336-7bf4-4b30-a538-c8570158b7fd', '925c4209-7750-4a6e-a000-73e1087331de', 'a28ade29-fb67-41c6-a26d-fdf67e0bc7ba'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:27 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:27 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:27 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9" returned: 0 in 0.566s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:27 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9 Sep 08 07:32:27 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:27 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Flow 'volume_create_manager' (531b01ce-b654-4f05-902c-03f762bb8171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f496cf1-b911-4b21-8509-56170a5cd852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.319s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f496cf1-b911-4b21-8509-56170a5cd852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-338008294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33d63ca-1eff-4239-86ab-c6e18d990800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f556ad388a4fd2b9ca2b91ec58f28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:28Z,use_quota=True,user_id='4aa949c66194448bae2c1fa7bfa562f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c8c682-c9ad-4b53-910d-76136f94b052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c8c682-c9ad-4b53-910d-76136f94b052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab30de1d-d30b-4238-81e3-e1080acb07a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab30de1d-d30b-4238-81e3-e1080acb07a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33d63ca-1eff-4239-86ab-c6e18d990800', 'volume_name': 'volume-d33d63ca-1eff-4239-86ab-c6e18d990800', 'volume_size': 2}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696970cf-d31d-4d3b-9369-c6710e5139dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696970cf-d31d-4d3b-9369-c6710e5139dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee8e42d-d442-4e6f-a9e3-93e9754c1026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Volume d33d63ca-1eff-4239-86ab-c6e18d990800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33d63ca-1eff-4239-86ab-c6e18d990800', 'volume_size': 2} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-338008294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33d63ca-1eff-4239-86ab-c6e18d990800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f556ad388a4fd2b9ca2b91ec58f28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:28Z,use_quota=True,user_id='4aa949c66194448bae2c1fa7bfa562f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Creating volume d33d63ca-1eff-4239-86ab-c6e18d990800 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:27 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 2147483648 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Deleted volume successfully. Sep 08 07:32:27 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 2147483648 Sep 08 07:32:27 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3f224e51-fc67-4791-9a49-2765bf729624 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-db48b519-2962-46ec-aae2-34fdcb77391c-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:28 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-86b829bb-7804-48d6-b092-8e791cc39aa9" returned: 0 in 0.286s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-quobyte-86b829bb-7804-48d6-b092-8e791cc39aa9" released by "delete_volume" :: held 0.938s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Created reservations ['ece9dcb1-0588-4edc-a8fb-9c009cb4a8f4', '7376cad8-dff8-4c63-8c43-a0269723605d', 'e499d8f0-9f8e-4585-a86d-140de74d08ad', 'd6d2d427-15a4-4fbe-89af-1eb4f2371a50'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:28 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:28 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:28 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 2147483648" returned: 0 in 0.534s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:28 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.300s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:28 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 Sep 08 07:32:28 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:28 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Deleted volume successfully. Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5957af1c-97c6-4af6-80b0-f1b1898512c5 tempest-VolumesSnapshotTestJSON-1685562781 None] Lock "cinder-86b829bb-7804-48d6-b092-8e791cc39aa9-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-quobyte-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e412e93-17e2-4355-bb85-def93ee8dc82]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:28 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800" returned: 0 in 0.308s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee8e42d-d442-4e6f-a9e3-93e9754c1026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33d63ca-1eff-4239-86ab-c6e18d990800', 'volume_size': 2}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0dd5d7-af6b-4d60-a11c-1afc2aba671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:28 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee Sep 08 07:32:28 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:28 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Volume volume-d33d63ca-1eff-4239-86ab-c6e18d990800 (d33d63ca-1eff-4239-86ab-c6e18d990800): created successfully Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0dd5d7-af6b-4d60-a11c-1afc2aba671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Flow 'volume_create_manager' (531b01ce-b654-4f05-902c-03f762bb8171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:28 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-66825c0f-e5c8-4042-a156-4aa87e37e31d tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Created volume successfully. Sep 08 07:32:29 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee" returned: 0 in 0.391s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:29 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee Sep 08 07:32:29 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:29 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee" returned: 0 in 0.257s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee" released by "delete_volume" :: held 0.704s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Created reservations ['3127911f-59f6-4e90-baf4-c8159a7fcf94', 'a1152f38-3f99-4f9d-8d15-21ddf8c5815e', 'b34600c6-7e95-46a9-86e1-338f40481bab', '2cb3594c-cbd4-4082-87db-a215189c23e2'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:29 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:29 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-4e8e7c8c-aee0-474b-9617-6b124740901e-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-4e8e7c8c-aee0-474b-9617-6b124740901e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:30 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.493s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:30 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Deleted volume successfully. Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-quobyte-4e8e7c8c-aee0-474b-9617-6b124740901e" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-4e8e7c8c-aee0-474b-9617-6b124740901e" acquired by "delete_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-993ee925-18da-4fd5-a94f-2ef809bb6b1d tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-9a3de9a0-664c-4de3-ae84-89c7f9a0dfee-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a257407c-8c30-4db8-bdb9-fa3fe9b3d9d1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Creating offline snapshot a6ab072e-d8f6-4fc3-b848-7e048b876e7b of volume d33d63ca-1eff-4239-86ab-c6e18d990800 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:32:30 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0bfa19-7689-445c-8503-e8a444017a0b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:30 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:30 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 Sep 08 07:32:30 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:30 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e" returned: 0 in 0.505s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:30 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e Sep 08 07:32:30 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:30 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800" returned: 0 in 0.475s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b 2G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:30 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b 2G Sep 08 07:32:30 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:31 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4e8e7c8c-aee0-474b-9617-6b124740901e" returned: 0 in 0.336s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-4e8e7c8c-aee0-474b-9617-6b124740901e" released by "delete_volume" :: held 0.909s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Created reservations ['fe93feda-65ae-4af0-bdbb-7e30dcf691bc', '957e01b5-5e66-4ffa-a763-f094fab2f476', '75e634cc-66f5-45e1-a3f7-65ea3f118a3a', '8e8ff719-de85-4b40-b30a-d931833111c9'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:31 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:31 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:31 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b 2G" returned: 0 in 0.627s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d33d63ca-1eff-4239-86ab-c6e18d990800 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:31 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d33d63ca-1eff-4239-86ab-c6e18d990800 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b Sep 08 07:32:31 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:31 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.279s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Deleted volume successfully. Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-51345c0f-791a-4410-925a-420e74410cde tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-4e8e7c8c-aee0-474b-9617-6b124740901e-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:31 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d33d63ca-1eff-4239-86ab-c6e18d990800 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b" returned: 0 in 0.334s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:31 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b is being set with open permissions: ugo+rw Sep 08 07:32:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:31 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b Sep 08 07:32:31 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:32 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b" returned: 0 in 0.273s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:32 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.info Sep 08 07:32:32 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=142,cinder:UPDATE=196,cinder:DELETE=14,cinder:INSERT=46 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-quobyte-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:32 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.info" returned: 0 in 0.384s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:32 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.info is being set with open permissions: ugo+rw Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a" acquired by "delete_volume" :: waited 0.041s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:32 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.info Sep 08 07:32:32 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b12fea2-4a7d-476e-8355-a7cbbac16a5b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:32 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a Sep 08 07:32:32 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:32 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.info" returned: 0 in 0.305s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-417a9874-1679-4efe-97ce-4521251f8740 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Create snapshot completed successfully Sep 08 07:32:32 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a" returned: 0 in 0.400s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:32 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a Sep 08 07:32:32 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:33 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a" returned: 0 in 0.262s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a" released by "delete_volume" :: held 0.719s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Created reservations ['9c590cce-dfff-4b29-b9e1-cf6c821e4840', '74aa1974-e556-406b-9d41-727c53abf7eb', '27209d7b-f850-46d6-ac03-6710c82e31f0', 'f32015bb-e3be-4cc8-9939-273d267eb1a1'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:33 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:33 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Acquiring lock "cinder-a6ab072e-d8f6-4fc3-b848-7e048b876e7b-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-a6ab072e-d8f6-4fc3-b848-7e048b876e7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Acquiring lock "cinder-quobyte-d33d63ca-1eff-4239-86ab-c6e18d990800" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:33 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-quobyte-d33d63ca-1eff-4239-86ab-c6e18d990800" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Acquiring lock "cinder-quobyte-a6ab072e-d8f6-4fc3-b848-7e048b876e7b" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.370s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:33 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Deleted volume successfully. Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-quobyte-a6ab072e-d8f6-4fc3-b848-7e048b876e7b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Deleting offline snapshot a6ab072e-d8f6-4fc3-b848-7e048b876e7b of volume d33d63ca-1eff-4239-86ab-c6e18d990800 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] snapshot_file for this snap is: volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88ed64f-a477-46e9-bbb1-67f4fc679069]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "cinder-quobyte-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6477be0e-db59-41d2-b74e-b8f47a180a69 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-ea0e8b33-4d3b-4a7d-a4df-cbd8d4e9577a-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[173a27f2-6526-4d3e-8fbf-71075627847c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:33 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b Sep 08 07:32:33 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:34 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 Sep 08 07:32:34 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:34 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b" returned: 0 in 0.459s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d33d63ca-1eff-4239-86ab-c6e18d990800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5be99d-5a2e-4881-bebe-88760aebe30a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:34 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793" returned: 0 in 0.559s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:34 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 Sep 08 07:32:34 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:34 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793 Sep 08 07:32:34 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:34 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793" returned: 0 in 0.408s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-quobyte-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793" released by "delete_volume" :: held 1.019s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:34 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800" returned: 0 in 0.573s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:34 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b Sep 08 07:32:34 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Created reservations ['13fa50ab-1f8d-446a-9acc-ba35a49a7d8c', '19a4d9c8-fbd7-4d0b-b319-ec0c0032096e', 'ced2cb39-e9e8-4861-88e9-ba185dbd73bb', 'e19eb529-698f-4ace-a772-1eac325cfde6'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:35 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:35 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:35 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.307s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Deleted volume successfully. Sep 08 07:32:35 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90d788c-d3d3-4936-a7c7-1d01f60446e7 tempest-CreateVolumesFromImageTest-273486602 None] Lock "cinder-58f1abb9-b3d2-4239-8f7b-f6ccf7c46793-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b" returned: 0 in 0.526s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:35 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b Sep 08 07:32:35 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Acquiring lock "cinder-a0890bae-64fc-4c67-bcb8-4469f21a30af-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Lock "cinder-a0890bae-64fc-4c67-bcb8-4469f21a30af-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:35 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800.a6ab072e-d8f6-4fc3-b848-7e048b876e7b" returned: 0 in 0.376s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-quobyte-a6ab072e-d8f6-4fc3-b848-7e048b876e7b" released by "_delete_snapshot" :: held 2.100s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Acquiring lock "cinder-quobyte-a0890bae-64fc-4c67-bcb8-4469f21a30af" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-quobyte-d33d63ca-1eff-4239-86ab-c6e18d990800" released by "delete_snapshot" :: held 2.127s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Lock "cinder-quobyte-a0890bae-64fc-4c67-bcb8-4469f21a30af" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e0ad32-84b7-44eb-9f3b-76668cbbaa13]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Created reservations ['e8892ab9-a187-414b-b0fe-e20244721848', 'a7d63ee8-3e5f-4539-b9f4-9449022708c1', 'b84e4fc6-254e-40c6-b12c-184beddec78b', '9c1484f2-27c1-4f7e-ab35-3e8aa295dcf5'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:36 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Delete snapshot completed successfully. Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04cfacd-ba24-40d8-8a94-7d404db381a7 tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-a6ab072e-d8f6-4fc3-b848-7e048b876e7b-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:36 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af Sep 08 07:32:36 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:36 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af" returned: 0 in 0.477s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:36 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af Sep 08 07:32:36 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:36 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a0890bae-64fc-4c67-bcb8-4469f21a30af" returned: 0 in 0.279s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Lock "cinder-quobyte-a0890bae-64fc-4c67-bcb8-4469f21a30af" released by "delete_volume" :: held 0.804s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Created reservations ['e9a5d641-8440-4064-a636-5a0064b2412f', '74bd5222-3517-45c7-8d44-04365aefa221', '7454cdce-441d-4ce2-a571-124f86735e6e', 'f148f1f7-fdcc-4e41-ba91-c0ea492c5957'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:36 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:36 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Acquiring lock "cinder-d33d63ca-1eff-4239-86ab-c6e18d990800-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-d33d63ca-1eff-4239-86ab-c6e18d990800-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Acquiring lock "cinder-quobyte-d33d63ca-1eff-4239-86ab-c6e18d990800" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-quobyte-d33d63ca-1eff-4239-86ab-c6e18d990800" acquired by "delete_volume" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:37 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd364b67-6b96-4d81-ac7e-198e3b1e841b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.435s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Deleted volume successfully. Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db42502c-970d-4904-94d3-39ecb11e7eac tempest-VolumesNegativeTest-1085391171 None] Lock "cinder-a0890bae-64fc-4c67-bcb8-4469f21a30af-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:37 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 Sep 08 07:32:37 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:37 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800" returned: 0 in 0.561s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:37 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800 Sep 08 07:32:37 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:38 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d33d63ca-1eff-4239-86ab-c6e18d990800" returned: 0 in 0.340s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-quobyte-d33d63ca-1eff-4239-86ab-c6e18d990800" released by "delete_volume" :: held 0.995s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Created reservations ['39892d3f-9e4b-48d5-a113-077727ee3572', '7f1ad6aa-ea1f-4083-803a-efbe5b4e5cfa', 'c5561c4a-fce7-43fa-b151-facc055158b7', 'e43f7783-714c-447b-93b8-5b57ddb46882'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:38 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:38 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:38 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.393s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Deleted volume successfully. Sep 08 07:32:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d8f2e10-4ad7-4225-a866-41808bdca2ce tempest-VolumesSnapshotNegativeTestJSON-212567067 None] Lock "cinder-d33d63ca-1eff-4239-86ab-c6e18d990800-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Flow 'volume_create_manager' (f3c30526-7b9d-49dc-a12b-7d764d436ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f6d758-569e-41f6-8593-bef7c1ad53cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f6d758-569e-41f6-8593-bef7c1ad53cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7592bfae-3c66-4d87-b23d-e335b4d44886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8335b9136baf4ca987e1a0092f88550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:41Z,use_quota=True,user_id='2c1c6192171e4a738061f641aaf87d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c30ee9-09ba-4fe1-8d59-da39520ea21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c30ee9-09ba-4fe1-8d59-da39520ea21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54073903-ed3d-476d-ade4-3dc9b4205ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54073903-ed3d-476d-ade4-3dc9b4205ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7592bfae-3c66-4d87-b23d-e335b4d44886', 'volume_name': 'volume-7592bfae-3c66-4d87-b23d-e335b4d44886', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c382858b-3304-4f2a-aba4-871d63840fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c382858b-3304-4f2a-aba4-871d63840fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd1a58e-7a40-474e-a5c5-827b59d29be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:40 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Volume 7592bfae-3c66-4d87-b23d-e335b4d44886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7592bfae-3c66-4d87-b23d-e335b4d44886', 'volume_size': 1} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7592bfae-3c66-4d87-b23d-e335b4d44886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8335b9136baf4ca987e1a0092f88550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:41Z,use_quota=True,user_id='2c1c6192171e4a738061f641aaf87d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Creating volume 7592bfae-3c66-4d87-b23d-e335b4d44886 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:40 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:40 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886 1073741824 Sep 08 07:32:40 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:41 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886 1073741824" returned: 0 in 0.510s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:41 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886 Sep 08 07:32:41 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:41 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886" returned: 0 in 0.281s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd1a58e-7a40-474e-a5c5-827b59d29be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7592bfae-3c66-4d87-b23d-e335b4d44886', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb35d40-77ec-4d92-af67-cab5ceed515e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:41 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Volume volume-7592bfae-3c66-4d87-b23d-e335b4d44886 (7592bfae-3c66-4d87-b23d-e335b4d44886): created successfully Sep 08 07:32:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb35d40-77ec-4d92-af67-cab5ceed515e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Flow 'volume_create_manager' (f3c30526-7b9d-49dc-a12b-7d764d436ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3a910539-1fd0-4dcb-b6a7-99a7dac1e2f2 tempest-CinderUnicodeTest-1357060498 None] Created volume successfully. Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Flow 'volume_create_manager' (f081f997-3f0a-4acc-89da-dcef476fe662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3208e074-88b3-47b1-bf83-e48ce46e621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3208e074-88b3-47b1-bf83-e48ce46e621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-986604641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bca9c4b-b9df-4f09-bcea-a897b697808d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8335b9136baf4ca987e1a0092f88550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:43Z,use_quota=True,user_id='2c1c6192171e4a738061f641aaf87d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e4c33e-a159-4b6a-a1ab-fae7e877b14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e4c33e-a159-4b6a-a1ab-fae7e877b14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c60ccf4-50d4-4d40-a35d-40b337d6acbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c60ccf4-50d4-4d40-a35d-40b337d6acbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bca9c4b-b9df-4f09-bcea-a897b697808d', 'volume_name': 'volume-5bca9c4b-b9df-4f09-bcea-a897b697808d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86265f6e-5c44-43a2-8a7a-87adea4d571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86265f6e-5c44-43a2-8a7a-87adea4d571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e27b031-cdc4-4629-b836-8acb7ca79632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:43 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Volume 5bca9c4b-b9df-4f09-bcea-a897b697808d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bca9c4b-b9df-4f09-bcea-a897b697808d', 'volume_size': 1} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-986604641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bca9c4b-b9df-4f09-bcea-a897b697808d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8335b9136baf4ca987e1a0092f88550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:43Z,use_quota=True,user_id='2c1c6192171e4a738061f641aaf87d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Creating volume 5bca9c4b-b9df-4f09-bcea-a897b697808d {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:43 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:43 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d 1073741824 Sep 08 07:32:43 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:44 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d 1073741824" returned: 0 in 0.802s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:44 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d Sep 08 07:32:44 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:44 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d" returned: 0 in 0.352s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e27b031-cdc4-4629-b836-8acb7ca79632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bca9c4b-b9df-4f09-bcea-a897b697808d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5802a2-da3e-4fe0-bacd-a63b8d0fc8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:44 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Volume volume-5bca9c4b-b9df-4f09-bcea-a897b697808d (5bca9c4b-b9df-4f09-bcea-a897b697808d): created successfully Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5802a2-da3e-4fe0-bacd-a63b8d0fc8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Flow 'volume_create_manager' (f081f997-3f0a-4acc-89da-dcef476fe662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:44 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1e9db649-ca63-4814-8bf9-d1f2aef411b6 tempest-CinderUnicodeTest-1357060498 None] Created volume successfully. Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:44 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:44 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:45 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.329s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Creating offline snapshot 6a46674b-c6a2-4f38-81d6-591257cad31d of volume 5bca9c4b-b9df-4f09-bcea-a897b697808d {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[911c8a8e-dfa8-4a38-8530-ada75db4df6d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:45 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d Sep 08 07:32:45 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:46 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d" returned: 0 in 0.429s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:46 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d 1G Sep 08 07:32:46 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:46 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d 1G" returned: 0 in 0.601s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bca9c4b-b9df-4f09-bcea-a897b697808d -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:46 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bca9c4b-b9df-4f09-bcea-a897b697808d -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d Sep 08 07:32:46 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:47 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bca9c4b-b9df-4f09-bcea-a897b697808d -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d" returned: 0 in 0.446s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:47 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d is being set with open permissions: ugo+rw Sep 08 07:32:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:47 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d Sep 08 07:32:47 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:47 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d" returned: 0 in 0.367s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:47 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.info Sep 08 07:32:47 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:48 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.info" returned: 0 in 0.384s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:48 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.info is being set with open permissions: ugo+rw Sep 08 07:32:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:48 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.info Sep 08 07:32:48 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:48 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.info" returned: 0 in 0.347s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.716s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:48 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c873d6b3-762b-4d3d-9fa3-001fc12c2437 tempest-CinderUnicodeTest-1357060498 None] Create snapshot completed successfully Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "cinder-6a46674b-c6a2-4f38-81d6-591257cad31d-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-6a46674b-c6a2-4f38-81d6-591257cad31d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "cinder-quobyte-5bca9c4b-b9df-4f09-bcea-a897b697808d" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-quobyte-5bca9c4b-b9df-4f09-bcea-a897b697808d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "cinder-quobyte-6a46674b-c6a2-4f38-81d6-591257cad31d" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-quobyte-6a46674b-c6a2-4f38-81d6-591257cad31d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Deleting offline snapshot 6a46674b-c6a2-4f38-81d6-591257cad31d of volume 5bca9c4b-b9df-4f09-bcea-a897b697808d {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] snapshot_file for this snap is: volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa99d54-1561-4434-a69e-b1d986f06562]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:49 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d Sep 08 07:32:49 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:49 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d" returned: 0 in 0.516s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bca9c4b-b9df-4f09-bcea-a897b697808d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[724ca7f2-b846-4a2f-ab54-53f383feb9d2]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:49 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d Sep 08 07:32:49 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Flow 'volume_create_manager' (1eec3074-5174-40bf-bb7a-8a50ee178d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f9589c-b90e-494c-a207-47213c0fd054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f9589c-b90e-494c-a207-47213c0fd054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cac5eba-a4cf-4cfc-818b-d9734ccea8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9862f58f285545afb594f611759bf110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:50Z,use_quota=True,user_id='5538f2bf0e3247e997fa0b5ab4fe4482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c836a91-2bc0-492c-a2b5-7f0e484158bc),volume_type_id=7c836a91-2bc0-492c-a2b5-7f0e484158bc)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993da34f-455c-4c19-9573-50c7838c1229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993da34f-455c-4c19-9573-50c7838c1229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b06a49-37c7-40e6-a0cd-ae4c1b7bce89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:32:50 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d" returned: 0 in 0.437s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:50 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d Sep 08 07:32:50 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b06a49-37c7-40e6-a0cd-ae4c1b7bce89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9cac5eba-a4cf-4cfc-818b-d9734ccea8a5', 'volume_name': 'volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5', 'volume_size': 1, 'image_id': 'c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7181164314721c958b11de1d5235950', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9862f58f285545afb594f611759bf110', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd322fae9bd17334ad0072b841566687528c60a2e6e8e347248199a2d66bfb7d96db9fb864468c487041ba199147cd26b5bc913947375744b366a7dcc8654ba2e', 'id': 'c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'created_at': datetime.datetime(2026, 9, 8, 5, 32, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 32, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5d5b862-1b6d-4ebd-a011-3fea332229e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19de617-6d9b-40b7-899e-49dd29b8da68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19de617-6d9b-40b7-899e-49dd29b8da68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e360d2f-6d6c-4830-a33f-923cf04152d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:50 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Volume 9cac5eba-a4cf-4cfc-818b-d9734ccea8a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5', 'volume_size': 1, 'image_id': 'c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7181164314721c958b11de1d5235950', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9862f58f285545afb594f611759bf110', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd322fae9bd17334ad0072b841566687528c60a2e6e8e347248199a2d66bfb7d96db9fb864468c487041ba199147cd26b5bc913947375744b366a7dcc8654ba2e', 'id': 'c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'created_at': datetime.datetime(2026, 9, 8, 5, 32, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 32, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5d5b862-1b6d-4ebd-a011-3fea332229e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Trying to clone 9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 from image c5d5b862-1b6d-4ebd-a011-3fea332229e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:32:50 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Image download 0.00 MB at 0.00 MB/s Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da00c9e-7e40-48ee-9c2b-e650f5914735]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:50 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d" returned: 0 in 0.573s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:50 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d Sep 08 07:32:50 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:50 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD Sep 08 07:32:50 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:51 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d.6a46674b-c6a2-4f38-81d6-591257cad31d" returned: 0 in 0.481s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:51 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD" returned: 0 in 0.542s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-quobyte-6a46674b-c6a2-4f38-81d6-591257cad31d" released by "_delete_snapshot" :: held 2.176s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-quobyte-5bca9c4b-b9df-4f09-bcea-a897b697808d" released by "delete_snapshot" :: held 2.207s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:51 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD Sep 08 07:32:51 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Created reservations ['0d7e0e79-6d4f-4823-b380-78228b9dda39', '7d57af5a-5043-41fc-8e80-478df917b689', 'f7a97383-e953-43bf-b328-867465fca7b9', '52137bc3-6099-4f67-8dc6-008da0293c0e'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:51 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Delete snapshot completed successfully. Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4146ca46-64cb-4d9a-8271-92c9875e0f5f tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-6a46674b-c6a2-4f38-81d6-591257cad31d-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:51 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD" returned: 1 in 0.502s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Temporary image c5d5b862-1b6d-4ebd-a011-3fea332229e5 is fetched for user 5538f2bf0e3247e997fa0b5ab4fe4482. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c31f01e-287e-4ded-8f4d-8fd73b38ef5f]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:52 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD Sep 08 07:32:52 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:52 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "cinder-5bca9c4b-b9df-4f09-bcea-a897b697808d-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-5bca9c4b-b9df-4f09-bcea-a897b697808d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "cinder-quobyte-5bca9c4b-b9df-4f09-bcea-a897b697808d" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-quobyte-5bca9c4b-b9df-4f09-bcea-a897b697808d" acquired by "delete_volume" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:52 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD Sep 08 07:32:52 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aac447e-eb7f-4249-9561-d11768ba89f7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:52 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d Sep 08 07:32:52 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:52 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD" returned: 1 in 0.643s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cac5eba-a4cf-4cfc-818b-d9734ccea8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9862f58f285545afb594f611759bf110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:32:50Z,use_quota=True,user_id='5538f2bf0e3247e997fa0b5ab4fe4482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c836a91-2bc0-492c-a2b5-7f0e484158bc),volume_type_id=7c836a91-2bc0-492c-a2b5-7f0e484158bc)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Creating volume 9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:32:52 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:32:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:53 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 1073741824 Sep 08 07:32:53 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:53 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d" returned: 0 in 0.482s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:53 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d Sep 08 07:32:53 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:53 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5bca9c4b-b9df-4f09-bcea-a897b697808d" returned: 0 in 0.335s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-quobyte-5bca9c4b-b9df-4f09-bcea-a897b697808d" released by "delete_volume" :: held 0.900s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Created reservations ['f1ebde25-db1c-426d-83d9-7b1a1b1ad17d', 'f5e6ca5a-7c0c-4172-9f76-7a7d9bc72eea', 'e8cf634c-595b-4a69-bde4-c5fe35f242e9', '953968d4-0fe4-43f8-bc6e-80f020d0640a'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:53 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 1073741824" returned: 0 in 0.612s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:53 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 Sep 08 07:32:53 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:53 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:53 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:54 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5" returned: 0 in 0.379s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Attempting download of c5d5b862-1b6d-4ebd-a011-3fea332229e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'metadata': {}}])) to volume 9cac5eba-a4cf-4cfc-818b-d9734ccea8a5. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:32:54 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.372s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:54 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Deleted volume successfully. Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02698fc-1c52-4e59-bfdf-c596a6740b70]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5d5b862-1b6d-4ebd-a011-3fea332229e5_5y8gauw1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f015408d-7020-4df2-900c-a09927d82b68 tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-5bca9c4b-b9df-4f09-bcea-a897b697808d-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:54 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5d5b862-1b6d-4ebd-a011-3fea332229e5_5y8gauw1 Sep 08 07:32:54 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:54 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5d5b862-1b6d-4ebd-a011-3fea332229e5_5y8gauw1" returned: 0 in 0.383s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5d5b862-1b6d-4ebd-a011-3fea332229e5_5y8gauw1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:54 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5d5b862-1b6d-4ebd-a011-3fea332229e5_5y8gauw1 Sep 08 07:32:54 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "cinder-7592bfae-3c66-4d87-b23d-e335b4d44886-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-7592bfae-3c66-4d87-b23d-e335b4d44886-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:54 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5d5b862-1b6d-4ebd-a011-3fea332229e5_5y8gauw1" returned: 1 in 0.388s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5d5b862-1b6d-4ebd-a011-3fea332229e5_5y8gauw1' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "cinder-quobyte-7592bfae-3c66-4d87-b23d-e335b4d44886" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3083ac58-0221-48b4-8d45-b12941878262]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-quobyte-7592bfae-3c66-4d87-b23d-e335b4d44886" acquired by "delete_volume" :: waited 0.044s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:55 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47a7e72-acd1-4572-a77f-fa69f35a77c4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:55 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD Sep 08 07:32:55 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:55 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886 Sep 08 07:32:55 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:55 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886" returned: 0 in 0.462s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:55 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD" returned: 0 in 0.596s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:55 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886 Sep 08 07:32:55 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:55 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD Sep 08 07:32:55 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:55 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7592bfae-3c66-4d87-b23d-e335b4d44886" returned: 0 in 0.406s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-quobyte-7592bfae-3c66-4d87-b23d-e335b4d44886" released by "delete_volume" :: held 0.968s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Created reservations ['7931a446-9dab-4666-a539-44f13a1d0fd1', '7c369e9d-6a88-41a5-8f5f-64cb9988e65f', '7e0968c2-be18-4441-9dba-26da6accd0f4', '32066188-b2bb-40b5-87d7-7f05345a2dfe'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:56 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD" returned: 1 in 0.510s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] c5d5b862-1b6d-4ebd-a011-3fea332229e5 was raw, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:56 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 Sep 08 07:32:56 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:56 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:56 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:56 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.354s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Deleted volume successfully. Sep 08 07:32:56 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7c0e1678-a9ef-4037-bf43-df5cac0dc8a2 tempest-CinderUnicodeTest-1357060498 None] Lock "cinder-7592bfae-3c66-4d87-b23d-e335b4d44886-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5" returned: 0 in 0.543s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5d5b862-1b6d-4ebd-a011-3fea332229e5_8luouksxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:32:56 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:56 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 1G Sep 08 07:32:56 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:56 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 1G" returned: 0 in 0.358s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Downloaded image c5d5b862-1b6d-4ebd-a011-3fea332229e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'metadata': {}}])) to volume 9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Temporary image c5d5b862-1b6d-4ebd-a011-3fea332229e5 for user 5538f2bf0e3247e997fa0b5ab4fe4482 is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Marking volume 9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Copying metadata from image c5d5b862-1b6d-4ebd-a011-3fea332229e5 to 9cac5eba-a4cf-4cfc-818b-d9734ccea8a5. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:32:56 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Creating volume glance metadata for volume 9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 backed by image c5d5b862-1b6d-4ebd-a011-3fea332229e5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c7181164314721c958b11de1d5235950', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e360d2f-6d6c-4830-a33f-923cf04152d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5', 'volume_size': 1, 'image_id': 'c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7181164314721c958b11de1d5235950', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9862f58f285545afb594f611759bf110', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd322fae9bd17334ad0072b841566687528c60a2e6e8e347248199a2d66bfb7d96db9fb864468c487041ba199147cd26b5bc913947375744b366a7dcc8654ba2e', 'id': 'c5d5b862-1b6d-4ebd-a011-3fea332229e5', 'created_at': datetime.datetime(2026, 9, 8, 5, 32, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 32, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5d5b862-1b6d-4ebd-a011-3fea332229e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbcb752-b550-4fc9-a0ba-52c16b92f687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:32:57 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Volume volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 (9cac5eba-a4cf-4cfc-818b-d9734ccea8a5): created successfully Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbcb752-b550-4fc9-a0ba-52c16b92f687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Flow 'volume_create_manager' (1eec3074-5174-40bf-bb7a-8a50ee178d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:32:57 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-28ddf3af-38b3-47a6-92ca-45405729ab79 tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Created volume successfully. Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Acquiring lock "cinder-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "cinder-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Acquiring lock "cinder-quobyte-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "cinder-quobyte-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a896b3f-b399-46b1-8611-70a0cfcb5404]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:32:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:57 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 Sep 08 07:32:57 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:58 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5" returned: 0 in 0.416s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:58 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5 Sep 08 07:32:58 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:58 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5" returned: 0 in 0.271s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "cinder-quobyte-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5" released by "delete_volume" :: held 0.742s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:32:58 devstack cinder-volume[87278]: WARNING cinder.quota [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:32:58 devstack cinder-volume[87278]: WARNING cinder.quota [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Created reservations ['dd3f8290-c39f-4b2b-9319-aa10378bc5b6', '9dc6ebac-9708-4f78-830d-21d2b5cecb74', '899b7df8-e2b7-4722-949e-b4faaa368889', '8b6ddecf-20c9-4d62-b149-2b3b94248841'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:32:58 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:32:58 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:32:58 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.287s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:32:58 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:32:58 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Deleted volume successfully. Sep 08 07:32:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5f8ca12d-2346-4cd1-9f97-2ffa1241589d tempest-VolumeAndVolumeTypeFromImageTest-1453154755 None] Lock "cinder-9cac5eba-a4cf-4cfc-818b-d9734ccea8a5-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:08 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=98,cinder:UPDATE=142,cinder:DELETE=12,cinder:INSERT=41 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:33:08 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=74,cinder:DELETE=4,cinder:SELECT=62,cinder:INSERT=22 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Flow 'volume_create_manager' (a9c170cd-e5c8-4dd5-ab94-dce5f8b4a06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4c88cd-d2cd-44b8-9c39-828750c354d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4c88cd-d2cd-44b8-9c39-828750c354d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-749998247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c8d050-7725-4a0d-9478-40ddb2627c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95629f42b53f486692eaa5da390448df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:13Z,use_quota=True,user_id='47bbd2082a084ee19a1dc986827da4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f82b9286-e0c8-43a5-b621-6408caf1d813),volume_type_id=f82b9286-e0c8-43a5-b621-6408caf1d813)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54f1826-5b30-4721-90de-17f33ac10db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54f1826-5b30-4721-90de-17f33ac10db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048ba9a7-aefb-46e3-ace7-3ceb9de9c646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048ba9a7-aefb-46e3-ace7-3ceb9de9c646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c8d050-7725-4a0d-9478-40ddb2627c17', 'volume_name': 'volume-f9c8d050-7725-4a0d-9478-40ddb2627c17', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82c1afd-d19f-4143-8fd2-532f1c335cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82c1afd-d19f-4143-8fd2-532f1c335cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5bd9d1-b526-4298-ab6f-958a29601e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:13 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Volume f9c8d050-7725-4a0d-9478-40ddb2627c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c8d050-7725-4a0d-9478-40ddb2627c17', 'volume_size': 1} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-749998247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c8d050-7725-4a0d-9478-40ddb2627c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95629f42b53f486692eaa5da390448df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:13Z,use_quota=True,user_id='47bbd2082a084ee19a1dc986827da4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f82b9286-e0c8-43a5-b621-6408caf1d813),volume_type_id=f82b9286-e0c8-43a5-b621-6408caf1d813)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Creating volume f9c8d050-7725-4a0d-9478-40ddb2627c17 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:13 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:13 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 1073741824 Sep 08 07:33:13 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:14 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 1073741824" returned: 0 in 0.620s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:14 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 Sep 08 07:33:14 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Flow 'volume_create_manager' (5ebe54e4-ebe0-4777-90b7-8a6e56bf341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1088d5-775f-45e0-b3b8-b03582755772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1088d5-775f-45e0-b3b8-b03582755772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025277005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ff2f92-1806-4512-8e99-e5a155e5e2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0465e2dce5408690873a52d6086602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:14Z,use_quota=True,user_id='7e3e4e3f2c7245dc91513f08dad2ca01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7c76e3-a2b3-4d8e-aa49-ee10b558dc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7c76e3-a2b3-4d8e-aa49-ee10b558dc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e940af5d-4346-48c4-8094-a1fe542b25b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e940af5d-4346-48c4-8094-a1fe542b25b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ff2f92-1806-4512-8e99-e5a155e5e2bc', 'volume_name': 'volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5d91b7-a18c-484c-96a5-42598e584c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5d91b7-a18c-484c-96a5-42598e584c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077fb532-cd0f-472c-8d1f-e0ecbdde8ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Volume 98ff2f92-1806-4512-8e99-e5a155e5e2bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc', 'volume_size': 1} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (81c9fa03-5731-4a61-a1de-ae6032938113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fd6e29-0492-4e26-9173-0a2214e7da6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fd6e29-0492-4e26-9173-0a2214e7da6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1333376302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0117455-85ca-45ac-b717-882022a44d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:14Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc8b57b-ed3d-48a7-bae4-d028c0877629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc8b57b-ed3d-48a7-bae4-d028c0877629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f46d24-27c8-40b0-9d5d-a0d54cf43c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f46d24-27c8-40b0-9d5d-a0d54cf43c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0117455-85ca-45ac-b717-882022a44d39', 'volume_name': 'volume-c0117455-85ca-45ac-b717-882022a44d39', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506ab404-3a10-4eb0-b49b-56da54023a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506ab404-3a10-4eb0-b49b-56da54023a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1d204c-a041-4430-8dea-19fe6a433e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume c0117455-85ca-45ac-b717-882022a44d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0117455-85ca-45ac-b717-882022a44d39', 'volume_size': 1} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:14 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17" returned: 0 in 0.424s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.195s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025277005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ff2f92-1806-4512-8e99-e5a155e5e2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0465e2dce5408690873a52d6086602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:14Z,use_quota=True,user_id='7e3e4e3f2c7245dc91513f08dad2ca01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Creating volume 98ff2f92-1806-4512-8e99-e5a155e5e2bc {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:14 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5bd9d1-b526-4298-ab6f-958a29601e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c8d050-7725-4a0d-9478-40ddb2627c17', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497c67d3-d2b0-4b06-b18f-62ef684e7644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc 1073741824 Sep 08 07:33:14 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Volume volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 (f9c8d050-7725-4a0d-9478-40ddb2627c17): created successfully Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497c67d3-d2b0-4b06-b18f-62ef684e7644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Flow 'volume_create_manager' (a9c170cd-e5c8-4dd5-ab94-dce5f8b4a06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Flow 'volume_create_manager' (1699cbf6-5f04-41f2-a165-e91c8cb60209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac2a721-9fe1-4620-81e6-9ff1c4ed80d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a847d9cd-6835-4482-be4a-ed7137da2b31 tempest-TestInstancesWithCinderVolumes-709434118 None] Created volume successfully. Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac2a721-9fe1-4620-81e6-9ff1c4ed80d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1554915386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23286c1-31ae-4021-9faa-05dbbf3ae8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95629f42b53f486692eaa5da390448df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:15Z,use_quota=True,user_id='47bbd2082a084ee19a1dc986827da4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81f1a2e6-c42b-4fd6-a27c-b36b274ba2cb),volume_type_id=81f1a2e6-c42b-4fd6-a27c-b36b274ba2cb)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2e09b4-7c9d-48cf-90ac-7b9bcad617c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2e09b4-7c9d-48cf-90ac-7b9bcad617c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bae7af-9248-484d-acba-179ab42c303d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bae7af-9248-484d-acba-179ab42c303d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23286c1-31ae-4021-9faa-05dbbf3ae8c9', 'volume_name': 'volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa77baa-4b92-4ba1-9430-dace1573efff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa77baa-4b92-4ba1-9430-dace1573efff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78be2b63-3f42-4d8b-b802-f6f4acec8347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Volume a23286c1-31ae-4021-9faa-05dbbf3ae8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9', 'volume_size': 1} Sep 08 07:33:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:15 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc 1073741824" returned: 0 in 0.649s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:15 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc Sep 08 07:33:15 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Flow 'volume_create_manager' (4d7859d2-0330-4c77-818f-0487e2fc620f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8757d4a9-3acc-4019-ba3a-3dd93c666c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8757d4a9-3acc-4019-ba3a-3dd93c666c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1542660015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efca2c8-8521-44f3-b11e-e3725ef7c190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95629f42b53f486692eaa5da390448df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:15Z,use_quota=True,user_id='47bbd2082a084ee19a1dc986827da4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5a6c84-59a6-473d-95ea-42c43a5f21b8),volume_type_id=3e5a6c84-59a6-473d-95ea-42c43a5f21b8)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e25d397-bec3-450e-b515-60d05329996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e25d397-bec3-450e-b515-60d05329996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33294dc8-3148-4b3f-9bbd-4e53b466c73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:33:15 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc" returned: 0 in 0.273s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.017s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1333376302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0117455-85ca-45ac-b717-882022a44d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:14Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Creating volume c0117455-85ca-45ac-b717-882022a44d39 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:15 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:15 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 1073741824 Sep 08 07:33:15 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077fb532-cd0f-472c-8d1f-e0ecbdde8ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493909ef-4a31-47d7-9fa3-9fe764ed78af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:15 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Volume volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc (98ff2f92-1806-4512-8e99-e5a155e5e2bc): created successfully Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493909ef-4a31-47d7-9fa3-9fe764ed78af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Flow 'volume_create_manager' (5ebe54e4-ebe0-4777-90b7-8a6e56bf341a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:15 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-917e80eb-d4ff-41d8-9d76-805eb01baed4 tempest-ProjectReaderTests-1219168849 None] Created volume successfully. Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33294dc8-3148-4b3f-9bbd-4e53b466c73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7efca2c8-8521-44f3-b11e-e3725ef7c190', 'volume_name': 'volume-7efca2c8-8521-44f3-b11e-e3725ef7c190', 'volume_size': 1, 'image_id': 'a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1382721718', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95629f42b53f486692eaa5da390448df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'created_at': datetime.datetime(2026, 9, 8, 5, 33, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 33, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0e0c766-1c09-4dd0-98d5-5baaa583d076/file', 'properties': {}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30041343-b8a8-4655-a08f-75a9ee6e877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30041343-b8a8-4655-a08f-75a9ee6e877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e806bc9f-2223-40ab-8f29-d7affc66b516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Volume 7efca2c8-8521-44f3-b11e-e3725ef7c190: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7efca2c8-8521-44f3-b11e-e3725ef7c190', 'volume_size': 1, 'image_id': 'a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1382721718', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95629f42b53f486692eaa5da390448df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'created_at': datetime.datetime(2026, 9, 8, 5, 33, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 33, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0e0c766-1c09-4dd0-98d5-5baaa583d076/file', 'properties': {}}, 'image_service': } Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Trying to clone 7efca2c8-8521-44f3-b11e-e3725ef7c190 from image a0e0c766-1c09-4dd0-98d5-5baaa583d076 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:33:16 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 1073741824" returned: 0 in 0.689s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:16 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 Sep 08 07:33:16 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "cinder-98ff2f92-1806-4512-8e99-e5a155e5e2bc-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-98ff2f92-1806-4512-8e99-e5a155e5e2bc-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "cinder-quobyte-98ff2f92-1806-4512-8e99-e5a155e5e2bc" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-quobyte-98ff2f92-1806-4512-8e99-e5a155e5e2bc" acquired by "delete_volume" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb8c507-14ab-4d97-9b54-5e398902cccf]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:16 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39" returned: 0 in 0.483s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1554915386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23286c1-31ae-4021-9faa-05dbbf3ae8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95629f42b53f486692eaa5da390448df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:15Z,use_quota=True,user_id='47bbd2082a084ee19a1dc986827da4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81f1a2e6-c42b-4fd6-a27c-b36b274ba2cb),volume_type_id=81f1a2e6-c42b-4fd6-a27c-b36b274ba2cb)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Creating volume a23286c1-31ae-4021-9faa-05dbbf3ae8c9 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:16 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:16 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc Sep 08 07:33:16 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1d204c-a041-4430-8dea-19fe6a433e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0117455-85ca-45ac-b717-882022a44d39', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a254b2-91c6-4f1e-b89c-6d2941106d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:16 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 1073741824 Sep 08 07:33:16 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume volume-c0117455-85ca-45ac-b717-882022a44d39 (c0117455-85ca-45ac-b717-882022a44d39): created successfully Sep 08 07:33:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a254b2-91c6-4f1e-b89c-6d2941106d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (81c9fa03-5731-4a61-a1de-ae6032938113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-08dd8158-2973-4c96-ad6c-34671488b798 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created volume successfully. Sep 08 07:33:17 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc" returned: 0 in 0.738s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:17 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc Sep 08 07:33:17 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:17 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 1073741824" returned: 0 in 0.996s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:17 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98ff2f92-1806-4512-8e99-e5a155e5e2bc" returned: 0 in 0.504s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-quobyte-98ff2f92-1806-4512-8e99-e5a155e5e2bc" released by "delete_volume" :: held 1.324s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:18 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 Sep 08 07:33:18 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Created reservations ['3e6243d0-3ae7-4a9c-ad18-512548b134ba', '401e6735-bae9-4ad8-a245-559c39a350df', 'df116742-1c15-4922-ac0f-6a2c540f02dc', 'cc9211e2-8c8a-4ff6-976f-65ba3a76d172'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:18 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:18 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:18 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9" returned: 0 in 0.355s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.498s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Creating offline snapshot 04b2326d-193f-49f6-8102-2c36be371238 of volume c0117455-85ca-45ac-b717-882022a44d39 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78be2b63-3f42-4d8b-b802-f6f4acec8347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf182d0-065e-4736-aba5-d76d973fb224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1934b7c-fbb0-4ace-8203-e3acaf263913]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:18 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Volume volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 (a23286c1-31ae-4021-9faa-05dbbf3ae8c9): created successfully Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf182d0-065e-4736-aba5-d76d973fb224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Flow 'volume_create_manager' (1699cbf6-5f04-41f2-a165-e91c8cb60209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:18 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9fed2f0d-d8ec-42b9-8ef7-23b11fb643c6 tempest-TestInstancesWithCinderVolumes-709434118 None] Created volume successfully. Sep 08 07:33:18 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.424s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:18 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Deleted volume successfully. Sep 08 07:33:18 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 Sep 08 07:33:18 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-67bb3c86-aaf8-4978-923d-93e7052ee2a8 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-98ff2f92-1806-4512-8e99-e5a155e5e2bc-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:19 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39" returned: 0 in 0.660s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:19 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 1G Sep 08 07:33:19 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Flow 'volume_create_manager' (211968a1-0b3e-4eed-a545-af86cab279f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d2670e-306c-4ce9-809b-0a0cbb33c93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d2670e-306c-4ce9-809b-0a0cbb33c93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465939558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a92768-7735-42ed-9624-e06bf626b6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0465e2dce5408690873a52d6086602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:19Z,use_quota=True,user_id='7e3e4e3f2c7245dc91513f08dad2ca01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c28feb-54d2-49fb-9745-70348364584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c28feb-54d2-49fb-9745-70348364584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3ed7de-fe34-4d1b-b295-4d367342eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3ed7de-fe34-4d1b-b295-4d367342eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a92768-7735-42ed-9624-e06bf626b6b6', 'volume_name': 'volume-06a92768-7735-42ed-9624-e06bf626b6b6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376799c6-46e2-4071-8f09-641bf41f3d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376799c6-46e2-4071-8f09-641bf41f3d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce703a88-d9fb-4993-b560-c0f43f908cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:19 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Volume 06a92768-7735-42ed-9624-e06bf626b6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a92768-7735-42ed-9624-e06bf626b6b6', 'volume_size': 1} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:19 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 1G" returned: 0 in 0.606s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0117455-85ca-45ac-b717-882022a44d39 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:19 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0117455-85ca-45ac-b717-882022a44d39 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 Sep 08 07:33:19 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:20 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0117455-85ca-45ac-b717-882022a44d39 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238" returned: 0 in 0.736s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:20 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 is being set with open permissions: ugo+rw Sep 08 07:33:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:20 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 Sep 08 07:33:20 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:20 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238" returned: 0 in 0.557s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:21 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.info Sep 08 07:33:21 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:21 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.info" returned: 0 in 0.437s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:21 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.info is being set with open permissions: ugo+rw Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:21 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.info Sep 08 07:33:21 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:21 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.info" returned: 0 in 0.385s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.592s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.338s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465939558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a92768-7735-42ed-9624-e06bf626b6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0465e2dce5408690873a52d6086602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:19Z,use_quota=True,user_id='7e3e4e3f2c7245dc91513f08dad2ca01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Creating volume 06a92768-7735-42ed-9624-e06bf626b6b6 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:21 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:22 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6 1073741824 Sep 08 07:33:22 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a567a409-058a-4b6e-9b81-40f1ee414b01 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Create snapshot completed successfully Sep 08 07:33:22 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6 1073741824" returned: 0 in 0.557s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:22 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6 Sep 08 07:33:22 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:22 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:23 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (d1ead873-a14b-48b4-b877-1f97e7a3e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de80a2b7-ce3b-445a-89ce-8dde886dfb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6" returned: 0 in 0.472s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce703a88-d9fb-4993-b560-c0f43f908cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a92768-7735-42ed-9624-e06bf626b6b6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3bd9c7-6650-475b-bdf8-ae4ea8188d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de80a2b7-ce3b-445a-89ce-8dde886dfb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153520972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7f9612-c34c-44f4-81b5-7639d240b96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:23Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd29d5b-d9a9-4700-b894-f26fe97dc7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd29d5b-d9a9-4700-b894-f26fe97dc7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50074947-c4f1-4fc5-b422-3d3d6822b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50074947-c4f1-4fc5-b422-3d3d6822b520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd7f9612-c34c-44f4-81b5-7639d240b96a', 'volume_name': 'volume-fd7f9612-c34c-44f4-81b5-7639d240b96a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6b5f5b-c8fe-4ba7-a781-3dd843287c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6b5f5b-c8fe-4ba7-a781-3dd843287c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c76abf-4076-415d-8998-77d3c07834ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume fd7f9612-c34c-44f4-81b5-7639d240b96a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd7f9612-c34c-44f4-81b5-7639d240b96a', 'volume_size': 1} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153520972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7f9612-c34c-44f4-81b5-7639d240b96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:23Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Creating volume fd7f9612-c34c-44f4-81b5-7639d240b96a {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:23 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Volume volume-06a92768-7735-42ed-9624-e06bf626b6b6 (06a92768-7735-42ed-9624-e06bf626b6b6): created successfully Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3bd9c7-6650-475b-bdf8-ae4ea8188d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Flow 'volume_create_manager' (211968a1-0b3e-4eed-a545-af86cab279f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:23 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a 1073741824 Sep 08 07:33:23 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:23 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fa74f698-b0cc-4893-97d5-7380a8df9b35 tempest-ProjectReaderTests-1219168849 None] Created volume successfully. Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (1c654978-7520-429d-9434-e83379796fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7cacc13-897d-41a8-a9c8-d54ec410b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7cacc13-897d-41a8-a9c8-d54ec410b229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676312151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d832e7b9-1564-4489-af71-7df43be965ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:24Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696c2d72-2962-478c-a533-bf1cc08511a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696c2d72-2962-478c-a533-bf1cc08511a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c69900-ef42-46b6-80d2-ce4f55793011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c69900-ef42-46b6-80d2-ce4f55793011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd832e7b9-1564-4489-af71-7df43be965ea', 'volume_name': 'volume-d832e7b9-1564-4489-af71-7df43be965ea', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738a12cb-d739-4788-977f-b68c50e628ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738a12cb-d739-4788-977f-b68c50e628ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18f6288-5807-4646-b955-8f1cc803777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume d832e7b9-1564-4489-af71-7df43be965ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d832e7b9-1564-4489-af71-7df43be965ea', 'volume_size': 1} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "cinder-06a92768-7735-42ed-9624-e06bf626b6b6-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-06a92768-7735-42ed-9624-e06bf626b6b6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "cinder-quobyte-06a92768-7735-42ed-9624-e06bf626b6b6" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-quobyte-06a92768-7735-42ed-9624-e06bf626b6b6" acquired by "delete_volume" :: waited 0.051s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5bc4c8-75ca-4aa4-b483-0cd732848601]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:24 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a 1073741824" returned: 0 in 1.127s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:24 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a Sep 08 07:33:24 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:24 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6 Sep 08 07:33:24 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD, size 20.69 MB, duration 8.44 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:33:24 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Image download 20.69 MB at 2.45 MB/s Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8321e8-be25-45d8-9052-8caaae2e96cb]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:24 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a" returned: 0 in 0.459s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676312151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d832e7b9-1564-4489-af71-7df43be965ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:24Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Creating volume d832e7b9-1564-4489-af71-7df43be965ea {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:24 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c76abf-4076-415d-8998-77d3c07834ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7f9612-c34c-44f4-81b5-7639d240b96a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:24 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea 1073741824 Sep 08 07:33:24 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD Sep 08 07:33:24 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:24 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8b72ba-0757-4d15-8f9d-0b4aa7584c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:25 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume volume-fd7f9612-c34c-44f4-81b5-7639d240b96a (fd7f9612-c34c-44f4-81b5-7639d240b96a): created successfully Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8b72ba-0757-4d15-8f9d-0b4aa7584c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (d1ead873-a14b-48b4-b877-1f97e7a3e40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:25 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bab9183b-6cf2-4ea9-9dd8-3b7cf055aa44 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created volume successfully. Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (57f295ab-ce6c-475c-a228-5fe49830fc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32753ef2-01ca-43cf-a811-1934876ccaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32753ef2-01ca-43cf-a811-1934876ccaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699385206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:25Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:25 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050dca73-8ac1-4458-8199-e929f68d090d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050dca73-8ac1-4458-8199-e929f68d090d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c709eed-b160-4488-8017-6d46bf997649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c709eed-b160-4488-8017-6d46bf997649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25c1f64-e2e4-4905-a7bd-0d9fdaaa301b', 'volume_name': 'volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857960d2-1735-4a8d-9ce7-a254033801e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:25 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857960d2-1735-4a8d-9ce7-a254033801e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3120bc-26df-42ed-8dd3-e0e9457cbf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:25 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b', 'volume_size': 1} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD" returned: 0 in 0.886s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Temporary image a0e0c766-1c09-4dd0-98d5-5baaa583d076 is fetched for user 47bbd2082a084ee19a1dc986827da4ce. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6" returned: 0 in 1.354s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:25 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6 Sep 08 07:33:25 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:25 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea 1073741824" returned: 0 in 0.866s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4855c78-af6b-41a5-888b-d8b8eaef8cb2]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:25 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea Sep 08 07:33:25 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:26 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06a92768-7735-42ed-9624-e06bf626b6b6" returned: 0 in 0.422s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-quobyte-06a92768-7735-42ed-9624-e06bf626b6b6" released by "delete_volume" :: held 1.886s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:26 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD Sep 08 07:33:26 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (6c831c4d-3d46-4a5f-b65f-b01e5e36ae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b607c73-cb8c-46bd-9888-87a061f00dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b607c73-cb8c-46bd-9888-87a061f00dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023826340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c6ea39-9d2b-4abe-96a3-b4b54af3db27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:26Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a878068-29af-4f38-8a55-2589749cfa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a878068-29af-4f38-8a55-2589749cfa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a575881b-a2c4-468e-a792-cd8d493c1722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a575881b-a2c4-468e-a792-cd8d493c1722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c6ea39-9d2b-4abe-96a3-b4b54af3db27', 'volume_name': 'volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9916f738-3c05-48eb-882b-aba727be1fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9916f738-3c05-48eb-882b-aba727be1fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db25e59e-b0df-4dfc-8cda-ec0f361cb24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume f6c6ea39-9d2b-4abe-96a3-b4b54af3db27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27', 'volume_size': 1} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea" returned: 0 in 0.458s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699385206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:25Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Creating volume d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:26 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Created reservations ['b848dd9d-f979-4d98-9450-5da23c88de9d', '29822623-b55c-4fc6-a3c1-bf43cd7bcfce', 'd70456fa-11be-4990-9ecc-2caebd926e11', 'f4c42e16-0dfa-41a0-be61-d0d8cc14ccc3'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18f6288-5807-4646-b955-8f1cc803777d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d832e7b9-1564-4489-af71-7df43be965ea', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cf90ef-389c-4b2c-a9f5-c1397adcdd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b 1073741824 Sep 08 07:33:26 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume volume-d832e7b9-1564-4489-af71-7df43be965ea (d832e7b9-1564-4489-af71-7df43be965ea): created successfully Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cf90ef-389c-4b2c-a9f5-c1397adcdd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (1c654978-7520-429d-9434-e83379796fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:26 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a34f02d7-152f-4919-9af8-51f1946bb2a2 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created volume successfully. Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD" returned: 0 in 0.819s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Flow 'volume_create_manager' (ec5076ea-a6c9-4a65-b38c-24428afbe435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e165a1-47a4-4a85-8779-3d8d306fce7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e165a1-47a4-4a85-8779-3d8d306fce7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1774347591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0179e9-e5bc-4ea9-9120-14f7ab3fa410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8880b4b0d874efe91387171d6b85a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:26Z,use_quota=True,user_id='641d7900b43643babecd25412ac01765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47930436-58ea-4ca9-908f-212be44c3a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47930436-58ea-4ca9-908f-212be44c3a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:26 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaed49e-1e72-410a-80fa-fde524c80ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaed49e-1e72-410a-80fa-fde524c80ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0179e9-e5bc-4ea9-9120-14f7ab3fa410', 'volume_name': 'volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13b96a8-2c17-41b6-983a-4f09459cf8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13b96a8-2c17-41b6-983a-4f09459cf8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9815f4f6-6dc7-4d7b-ba60-d0f5eaf2ce74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Volume 4b0179e9-e5bc-4ea9-9120-14f7ab3fa410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410', 'volume_size': 1} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (f3e6a78c-64b3-4add-8fd4-4691843dc764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7a13d0-477a-4c37-973d-c856993704ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7a13d0-477a-4c37-973d-c856993704ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1984449919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da380535-4155-4b84-a78b-3c9c0dc789dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:27Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dc3af3-49de-4967-9eba-95316634eaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dc3af3-49de-4967-9eba-95316634eaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec0ceab-4428-4ab0-bf0f-7c72b65ee315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec0ceab-4428-4ab0-bf0f-7c72b65ee315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da380535-4155-4b84-a78b-3c9c0dc789dd', 'volume_name': 'volume-da380535-4155-4b84-a78b-3c9c0dc789dd', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d4b95e-6aa9-4890-b540-5b326b5704ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d4b95e-6aa9-4890-b540-5b326b5704ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b89d54b-5683-42cc-827d-f19d13dd26b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume da380535-4155-4b84-a78b-3c9c0dc789dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da380535-4155-4b84-a78b-3c9c0dc789dd', 'volume_size': 1} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:27 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b 1073741824" returned: 0 in 0.820s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:27 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b Sep 08 07:33:27 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:27 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.578s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Deleted volume successfully. Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca5e1ba5-e616-43e6-90bf-4e6926b4b459 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-06a92768-7735-42ed-9624-e06bf626b6b6-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:27 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b" returned: 0 in 0.361s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023826340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c6ea39-9d2b-4abe-96a3-b4b54af3db27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:26Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Creating volume f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:27 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:27 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 1073741824 Sep 08 07:33:27 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3120bc-26df-42ed-8dd3-e0e9457cbf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25de16e3-c693-48d9-aace-e62b9f98fdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Flow 'volume_create_manager' (97784c75-4a72-46ef-8dce-808d4742124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2efa4c-c1fb-4539-b062-32dcb6d30767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b (d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b): created successfully Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25de16e3-c693-48d9-aace-e62b9f98fdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (57f295ab-ce6c-475c-a228-5fe49830fc75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2efa4c-c1fb-4539-b062-32dcb6d30767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1319370359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be405b06-d311-4cd4-8565-1f0a84ba70f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0465e2dce5408690873a52d6086602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:28Z,use_quota=True,user_id='7e3e4e3f2c7245dc91513f08dad2ca01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd60d92-8b9d-47d1-9e82-a59ded461ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd60d92-8b9d-47d1-9e82-a59ded461ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db192ac1-57d2-4e87-8aeb-cfaed9af5e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db192ac1-57d2-4e87-8aeb-cfaed9af5e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be405b06-d311-4cd4-8565-1f0a84ba70f1', 'volume_name': 'volume-be405b06-d311-4cd4-8565-1f0a84ba70f1', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7024ce44-9b3b-46f8-9e17-930867c9bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7024ce44-9b3b-46f8-9e17-930867c9bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f1984a-efec-4268-add5-4f01fa7c02d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Volume be405b06-d311-4cd4-8565-1f0a84ba70f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be405b06-d311-4cd4-8565-1f0a84ba70f1', 'volume_size': 1} Sep 08 07:33:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1c780262-4f13-423a-b7ce-710d4b13542b tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created volume successfully. Sep 08 07:33:28 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 1073741824" returned: 0 in 0.419s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:28 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 Sep 08 07:33:28 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:28 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27" returned: 0 in 0.264s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1542660015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efca2c8-8521-44f3-b11e-e3725ef7c190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95629f42b53f486692eaa5da390448df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:15Z,use_quota=True,user_id='47bbd2082a084ee19a1dc986827da4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5a6c84-59a6-473d-95ea-42c43a5f21b8),volume_type_id=3e5a6c84-59a6-473d-95ea-42c43a5f21b8)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Creating volume 7efca2c8-8521-44f3-b11e-e3725ef7c190 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:28 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db25e59e-b0df-4dfc-8cda-ec0f361cb24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:28 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 1073741824 Sep 08 07:33:28 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003204ab-5916-425a-958f-e9b2588aea95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:28 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 (f6c6ea39-9d2b-4abe-96a3-b4b54af3db27): created successfully Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003204ab-5916-425a-958f-e9b2588aea95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (6c831c4d-3d46-4a5f-b65f-b01e5e36ae5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:28 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c5357aed-c7a8-4580-a4d4-230e3c5d0062 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created volume successfully. Sep 08 07:33:28 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 1073741824" returned: 0 in 0.460s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:28 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 Sep 08 07:33:28 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:29 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.268s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1774347591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0179e9-e5bc-4ea9-9120-14f7ab3fa410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8880b4b0d874efe91387171d6b85a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:26Z,use_quota=True,user_id='641d7900b43643babecd25412ac01765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Creating volume 4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:29 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:29 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 1073741824 Sep 08 07:33:29 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Attempting download of a0e0c766-1c09-4dd0-98d5-5baaa583d076 ((None, [{'url': 'file:///opt/stack/data/glance/images/a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'metadata': {}}])) to volume 7efca2c8-8521-44f3-b11e-e3725ef7c190. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd6fc4-e245-4937-9ac4-b7b59712a1dd]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gnywg82q {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:29 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gnywg82q Sep 08 07:33:29 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:29 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gnywg82q" returned: 0 in 0.372s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:29 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gnywg82q {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 1073741824" returned: 0 in 0.499s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:29 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 Sep 08 07:33:29 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:29 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gnywg82q Sep 08 07:33:29 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:29 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410" returned: 0 in 0.279s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.901s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1984449919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da380535-4155-4b84-a78b-3c9c0dc789dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de98bee6d5b4288b06b26ddb08f8cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:27Z,use_quota=True,user_id='8d2ebfa325c34983a1537e5085882ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Creating volume da380535-4155-4b84-a78b-3c9c0dc789dd {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:29 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:29 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gnywg82q" returned: 1 in 0.420s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gnywg82q' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9815f4f6-6dc7-4d7b-ba60-d0f5eaf2ce74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:30 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd 1073741824 Sep 08 07:33:30 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14017f30-cad3-463a-82a5-62459db90a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbca68d9-4dd7-4c7c-b2ee-1d45aee11ecb]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:30 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Volume volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 (4b0179e9-e5bc-4ea9-9120-14f7ab3fa410): created successfully Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14017f30-cad3-463a-82a5-62459db90a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Flow 'volume_create_manager' (ec5076ea-a6c9-4a65-b38c-24428afbe435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:30 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-338be618-5635-4fd6-b405-c26d56e70d3b tempest-TestMinimumBasicScenario-1351601952 None] Created volume successfully. Sep 08 07:33:30 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD Sep 08 07:33:30 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:30 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] a0e0c766-1c09-4dd0-98d5-5baaa583d076 was qcow2, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:33:30 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd 1073741824" returned: 0 in 0.460s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:30 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 Sep 08 07:33:30 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:30 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd Sep 08 07:33:30 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:30 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd" returned: 0 in 0.378s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.126s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1319370359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be405b06-d311-4cd4-8565-1f0a84ba70f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0465e2dce5408690873a52d6086602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:28Z,use_quota=True,user_id='7e3e4e3f2c7245dc91513f08dad2ca01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Creating volume be405b06-d311-4cd4-8565-1f0a84ba70f1 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:30 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:30 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 1073741824 Sep 08 07:33:30 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b89d54b-5683-42cc-827d-f19d13dd26b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da380535-4155-4b84-a78b-3c9c0dc789dd', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00afffb7-c459-4cde-8707-3bdc2949eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:31 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Volume volume-da380535-4155-4b84-a78b-3c9c0dc789dd (da380535-4155-4b84-a78b-3c9c0dc789dd): created successfully Sep 08 07:33:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00afffb7-c459-4cde-8707-3bdc2949eb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Flow 'volume_create_manager' (f3e6a78c-64b3-4add-8fd4-4691843dc764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-df94debf-e069-485e-bb34-0070a374a5ba tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created volume successfully. Sep 08 07:33:31 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 1073741824" returned: 0 in 0.745s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:31 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 Sep 08 07:33:31 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-b8d4ce01-51cc-4f26-a431-7dd6817dc0a5 req-f22b1015-e143-4e9a-b1ed-a2be681bacb1 tempest-TestMinimumBasicScenario-1351601952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-da380535-4155-4b84-a78b-3c9c0dc789dd-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-da380535-4155-4b84-a78b-3c9c0dc789dd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:32 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1" returned: 0 in 0.393s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-b8d4ce01-51cc-4f26-a431-7dd6817dc0a5 req-f22b1015-e143-4e9a-b1ed-a2be681bacb1 tempest-TestMinimumBasicScenario-1351601952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.214s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f1984a-efec-4268-add5-4f01fa7c02d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be405b06-d311-4cd4-8565-1f0a84ba70f1', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29c0d72-52c4-448d-8ca4-73f1dcc9aff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-b8d4ce01-51cc-4f26-a431-7dd6817dc0a5 req-f22b1015-e143-4e9a-b1ed-a2be681bacb1 tempest-TestMinimumBasicScenario-1351601952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:32 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Volume volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 (be405b06-d311-4cd4-8565-1f0a84ba70f1): created successfully Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29c0d72-52c4-448d-8ca4-73f1dcc9aff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Flow 'volume_create_manager' (97784c75-4a72-46ef-8dce-808d4742124e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0e2482e8-5b82-421c-8575-44cce7cba28f tempest-ProjectReaderTests-1219168849 None] Created volume successfully. Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-b8d4ce01-51cc-4f26-a431-7dd6817dc0a5 req-f22b1015-e143-4e9a-b1ed-a2be681bacb1 tempest-TestMinimumBasicScenario-1351601952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2d50ca7-bf88-4640-aab4-b9d25d96fc01', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-quobyte-da380535-4155-4b84-a78b-3c9c0dc789dd" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-da380535-4155-4b84-a78b-3c9c0dc789dd" acquired by "delete_volume" :: waited 0.029s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb59c3a-de73-487c-84d9-9ab02539da0a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-b8d4ce01-51cc-4f26-a431-7dd6817dc0a5 req-f22b1015-e143-4e9a-b1ed-a2be681bacb1 tempest-TestMinimumBasicScenario-1351601952 None] attachment_update completed successfully. Sep 08 07:33:32 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd Sep 08 07:33:32 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:32 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:32 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190" returned: 0 in 2.445s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd" returned: 0 in 0.584s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a0e0c766-1c09-4dd0-98d5-5baaa583d076_gcwtr7v6devstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:33:32 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Converted 112.00 MB image at 45.72 MB/s Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:32 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 1G Sep 08 07:33:32 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:32 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd Sep 08 07:33:32 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:33 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "cinder-be405b06-d311-4cd4-8565-1f0a84ba70f1-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-da380535-4155-4b84-a78b-3c9c0dc789dd" returned: 0 in 0.299s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-be405b06-d311-4cd4-8565-1f0a84ba70f1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-da380535-4155-4b84-a78b-3c9c0dc789dd" released by "delete_volume" :: held 0.979s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "cinder-quobyte-be405b06-d311-4cd4-8565-1f0a84ba70f1" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-quobyte-be405b06-d311-4cd4-8565-1f0a84ba70f1" acquired by "delete_volume" :: waited 0.042s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created reservations ['c7798961-d765-4173-9203-ac73aa1a4bcc', '9fb127b5-ccec-4c42-86f4-c8ea1a81dcbf', '22f8b4a9-fc4e-4303-9d70-bfb137c5118c', '801d398f-f432-46ef-9d4e-bf1cc8934f4b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fe7668-fabc-42bc-93b6-1072e678f9e4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:33 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 1G" returned: 0 in 0.567s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Downloaded image a0e0c766-1c09-4dd0-98d5-5baaa583d076 ((None, [{'url': 'file:///opt/stack/data/glance/images/a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'metadata': {}}])) to volume 7efca2c8-8521-44f3-b11e-e3725ef7c190 successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Temporary image a0e0c766-1c09-4dd0-98d5-5baaa583d076 for user 47bbd2082a084ee19a1dc986827da4ce is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Marking volume 7efca2c8-8521-44f3-b11e-e3725ef7c190 as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Copying metadata from image a0e0c766-1c09-4dd0-98d5-5baaa583d076 to 7efca2c8-8521-44f3-b11e-e3725ef7c190. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Creating volume glance metadata for volume 7efca2c8-8521-44f3-b11e-e3725ef7c190 backed by image a0e0c766-1c09-4dd0-98d5-5baaa583d076 with: {'image_id': 'a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'image_name': 'tempest-scenario-img--1382721718', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:33 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:33 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e806bc9f-2223-40ab-8f29-d7affc66b516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efca2c8-8521-44f3-b11e-e3725ef7c190', 'volume_size': 1, 'image_id': 'a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1382721718', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95629f42b53f486692eaa5da390448df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a0e0c766-1c09-4dd0-98d5-5baaa583d076', 'created_at': datetime.datetime(2026, 9, 8, 5, 33, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 33, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0e0c766-1c09-4dd0-98d5-5baaa583d076/file', 'properties': {}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a537f34d-2b20-4836-82fe-b7ff8f6a4372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:33 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 Sep 08 07:33:33 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:33 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Volume volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 (7efca2c8-8521-44f3-b11e-e3725ef7c190): created successfully Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a537f34d-2b20-4836-82fe-b7ff8f6a4372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Flow 'volume_create_manager' (4d7859d2-0330-4c77-818f-0487e2fc620f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:33 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-202b5032-7045-4cc0-b45b-4d6673dd7110 tempest-TestInstancesWithCinderVolumes-709434118 None] Created volume successfully. Sep 08 07:33:33 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.428s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:33 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:33 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Deleted volume successfully. Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b44afd5c-37f1-4f6c-bb20-4f96ab777d17 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-da380535-4155-4b84-a78b-3c9c0dc789dd-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:34 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1" returned: 0 in 0.642s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:34 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1 Sep 08 07:33:34 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:34 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-be405b06-d311-4cd4-8565-1f0a84ba70f1" returned: 0 in 0.350s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-quobyte-be405b06-d311-4cd4-8565-1f0a84ba70f1" released by "delete_volume" :: held 1.086s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Created reservations ['2a1135af-b9b7-4153-80c1-864b888b5b34', 'a42cdb72-1060-40ee-be89-1ccf7600ad48', 'f81ccfd6-8b04-4801-8daf-81ebb3c24704', '5897e369-096a-49be-b3e0-405e71d251e6'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-quobyte-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27" acquired by "delete_volume" :: waited 0.062s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:34 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:34 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[099e6492-6e26-4faf-937b-e5544fbfc4f5]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:35 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 Sep 08 07:33:35 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:35 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.496s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:35 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Deleted volume successfully. Sep 08 07:33:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4843f4ec-2f75-420a-b570-67ed53c461a3 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-be405b06-d311-4cd4-8565-1f0a84ba70f1-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:35 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27" returned: 0 in 0.524s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:35 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27 Sep 08 07:33:35 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:35 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27" returned: 0 in 0.449s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27" released by "delete_volume" :: held 1.063s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:35 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created reservations ['5f5e0e38-1a17-47eb-a759-6085cdb9e422', 'c9ae4236-f189-435b-8a01-eb5d020d733a', '8b13fdf8-57f5-4288-a7d2-627ca09b47b7', '09223eda-2f03-4285-84ce-29f99b340882'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:36 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:36 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:36 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Flow 'volume_create_manager' (e9313fbb-06a1-4bee-85a3-bf39320214b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e873f1e0-8f90-48e2-99ba-f323d1dd13a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.365s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:36 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Deleted volume successfully. Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e873f1e0-8f90-48e2-99ba-f323d1dd13a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-37449217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc95f661-191d-4be8-98f6-6f6b58f0d47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0465e2dce5408690873a52d6086602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:36Z,use_quota=True,user_id='7e3e4e3f2c7245dc91513f08dad2ca01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4372e7c7-063e-4369-b7f6-055fd72d2550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4372e7c7-063e-4369-b7f6-055fd72d2550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612319e7-a082-409c-8dc7-cb468c04a1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612319e7-a082-409c-8dc7-cb468c04a1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc95f661-191d-4be8-98f6-6f6b58f0d47e', 'volume_name': 'volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7b0afe-7803-4765-9fcd-0f82f874277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7b0afe-7803-4765-9fcd-0f82f874277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244e81e6-e859-41d8-8132-41f032e576b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:36 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Volume dc95f661-191d-4be8-98f6-6f6b58f0d47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e', 'volume_size': 1} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-37449217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc95f661-191d-4be8-98f6-6f6b58f0d47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0465e2dce5408690873a52d6086602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:33:36Z,use_quota=True,user_id='7e3e4e3f2c7245dc91513f08dad2ca01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Creating volume dc95f661-191d-4be8-98f6-6f6b58f0d47e {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:33:36 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-f162abab-96d1-493e-88e1-b265ba59af39 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-f6c6ea39-9d2b-4abe-96a3-b4b54af3db27-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:36 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e 1073741824 Sep 08 07:33:36 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-quobyte-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1430da-3921-4fa6-b489-59c7d50f6192]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:37 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e 1073741824" returned: 0 in 0.732s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:37 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e Sep 08 07:33:37 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:37 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b Sep 08 07:33:37 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:37 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e" returned: 0 in 0.390s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:37 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244e81e6-e859-41d8-8132-41f032e576b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ad8aad-3ca4-48f7-a7f6-9cc6bf137b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b" returned: 0 in 0.627s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-5656483a-3000-4f9b-a549-6f2c689ac98a req-384ff3c8-27e3-4aef-914a-8af036ed6823 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-5656483a-3000-4f9b-a549-6f2c689ac98a req-384ff3c8-27e3-4aef-914a-8af036ed6823 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:37 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Volume volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e (dc95f661-191d-4be8-98f6-6f6b58f0d47e): created successfully Sep 08 07:33:37 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b Sep 08 07:33:37 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ad8aad-3ca4-48f7-a7f6-9cc6bf137b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Flow 'volume_create_manager' (e9313fbb-06a1-4bee-85a3-bf39320214b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-5656483a-3000-4f9b-a549-6f2c689ac98a req-384ff3c8-27e3-4aef-914a-8af036ed6823 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9bb16683-6974-4b15-bda6-ea4913755463 tempest-ProjectReaderTests-1219168849 None] Created volume successfully. Sep 08 07:33:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-5656483a-3000-4f9b-a549-6f2c689ac98a req-384ff3c8-27e3-4aef-914a-8af036ed6823 tempest-TestInstancesWithCinderVolumes-709434118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-7efca2c8-8521-44f3-b11e-e3725ef7c190', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f517d48-f980-4d29-a636-41d9c261127a', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:33:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-5656483a-3000-4f9b-a549-6f2c689ac98a req-384ff3c8-27e3-4aef-914a-8af036ed6823 tempest-TestInstancesWithCinderVolumes-709434118 None] attachment_update completed successfully. Sep 08 07:33:38 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b" returned: 0 in 0.335s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b" released by "delete_volume" :: held 1.054s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created reservations ['22f05740-d3ae-4850-a355-766ac8ad0a04', '2f6b817d-8462-4e53-8aa0-a8cc3fb3f788', 'f25072d4-1cd2-4264-9a1e-e9a4aa6ba548', 'c637b236-1737-46a8-848b-db664bece4c4'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:38 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:38 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "cinder-dc95f661-191d-4be8-98f6-6f6b58f0d47e-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-dc95f661-191d-4be8-98f6-6f6b58f0d47e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "cinder-quobyte-dc95f661-191d-4be8-98f6-6f6b58f0d47e" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:38 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.488s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Deleted volume successfully. Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-quobyte-dc95f661-191d-4be8-98f6-6f6b58f0d47e" acquired by "delete_volume" :: waited 0.047s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4b40586d-c5b7-43fe-83f5-52d608f78582 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-d25c1f64-e2e4-4905-a7bd-0d9fdaaa301b-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[25268647-8269-4199-a3c8-16d734398755]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:39 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e Sep 08 07:33:39 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:39 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e" returned: 0 in 0.456s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-d832e7b9-1564-4489-af71-7df43be965ea-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-d832e7b9-1564-4489-af71-7df43be965ea-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:39 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e Sep 08 07:33:39 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-quobyte-d832e7b9-1564-4489-af71-7df43be965ea" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-d832e7b9-1564-4489-af71-7df43be965ea" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[236fe54b-69a7-40ad-b25f-7852a0ef36ff]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:39 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea Sep 08 07:33:39 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:39 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dc95f661-191d-4be8-98f6-6f6b58f0d47e" returned: 0 in 0.370s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-quobyte-dc95f661-191d-4be8-98f6-6f6b58f0d47e" released by "delete_volume" :: held 0.908s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Created reservations ['11f3beb5-9cb3-4892-bc9b-40f8b96c4535', '7bf751c5-3e04-4030-9ab6-ed7af570348c', '81b81bbb-34be-45a5-9e2f-9afcc576dc83', 'a8ff48df-8bfd-4140-a123-17aed14b58fc'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:40 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:40 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:40 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea" returned: 0 in 0.647s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:40 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea Sep 08 07:33:40 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:40 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.335s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Deleted volume successfully. Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dca851c-227a-42bc-af1d-2bd7f67de0c5 tempest-ProjectReaderTests-1219168849 None] Lock "cinder-dc95f661-191d-4be8-98f6-6f6b58f0d47e-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:40 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d832e7b9-1564-4489-af71-7df43be965ea" returned: 0 in 0.314s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-d832e7b9-1564-4489-af71-7df43be965ea" released by "delete_volume" :: held 1.008s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created reservations ['1de47529-c0c8-487a-b33e-6833adb1a87a', 'd6639f4a-d256-43f2-9a73-f1745aeea9ae', '283500bc-e64c-465c-83a1-a180e4896a8f', '32e5cb96-a1aa-4413-ab6c-69788fcf17a7'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:40 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:40 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:40 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.289s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:40 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Deleted volume successfully. Sep 08 07:33:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7ee8317b-ff3b-452f-9eb1-8f58308477b8 tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-d832e7b9-1564-4489-af71-7df43be965ea-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-fd7f9612-c34c-44f4-81b5-7639d240b96a-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-fd7f9612-c34c-44f4-81b5-7639d240b96a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-quobyte-fd7f9612-c34c-44f4-81b5-7639d240b96a" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-fd7f9612-c34c-44f4-81b5-7639d240b96a" acquired by "delete_volume" :: waited 0.055s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f2ae6a-de20-40a4-8483-9afe88b14b0c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:42 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a Sep 08 07:33:42 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:42 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a" returned: 0 in 0.679s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:42 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a Sep 08 07:33:42 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:43 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fd7f9612-c34c-44f4-81b5-7639d240b96a" returned: 0 in 0.342s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-fd7f9612-c34c-44f4-81b5-7639d240b96a" released by "delete_volume" :: held 1.125s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:43 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created reservations ['68662e38-3991-4a9b-823e-afabd0b89757', '59403112-92a8-4576-9c8d-bf25111ddfe6', 'b07d8797-a3ad-49cc-b37f-39c423fa7d8a', '46f773ea-eadd-4132-8910-030956c0043c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:43 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:43 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:44 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.439s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:44 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Deleted volume successfully. Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b04efc71-dcf2-4daf-9356-1c5683e4871d tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-fd7f9612-c34c-44f4-81b5-7639d240b96a-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-04b2326d-193f-49f6-8102-2c36be371238-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-04b2326d-193f-49f6-8102-2c36be371238-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-quobyte-c0117455-85ca-45ac-b717-882022a44d39" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-c0117455-85ca-45ac-b717-882022a44d39" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-quobyte-04b2326d-193f-49f6-8102-2c36be371238" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-04b2326d-193f-49f6-8102-2c36be371238" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Deleting offline snapshot 04b2326d-193f-49f6-8102-2c36be371238 of volume c0117455-85ca-45ac-b717-882022a44d39 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] snapshot_file for this snap is: volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[684588c5-9faf-4799-81ef-9d9d49400619]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:44 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 Sep 08 07:33:44 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:44 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:44 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:45 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.371s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:33:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:33:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:33:45 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238" returned: 0 in 0.910s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0117455-85ca-45ac-b717-882022a44d39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:33:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc93f1f-aa8b-4d93-bb22-34679e24df71]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:45 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 Sep 08 07:33:45 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:46 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39" returned: 0 in 0.581s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:46 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 Sep 08 07:33:46 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:46 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238" returned: 0 in 0.644s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:46 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238 Sep 08 07:33:46 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:46 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39.04b2326d-193f-49f6-8102-2c36be371238" returned: 0 in 0.337s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-04b2326d-193f-49f6-8102-2c36be371238" released by "_delete_snapshot" :: held 2.658s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-c0117455-85ca-45ac-b717-882022a44d39" released by "delete_snapshot" :: held 2.700s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created reservations ['1981aea9-684d-4abf-b6d7-79b794fdc69d', 'dd8f451c-f1bd-4ad7-823f-768de245be74', 'c0254ccf-c4da-4b99-8acc-16be7d63fc69', '908d0518-a8a9-497c-8ac9-6e01149473c4'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Delete snapshot completed successfully. Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf85baac-b455-40d3-8f44-d14140a1664f tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-04b2326d-193f-49f6-8102-2c36be371238-delete_snapshot" released by "delete_snapshot" :: held 2.882s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-c0117455-85ca-45ac-b717-882022a44d39-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-c0117455-85ca-45ac-b717-882022a44d39-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "cinder-quobyte-c0117455-85ca-45ac-b717-882022a44d39" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-c0117455-85ca-45ac-b717-882022a44d39" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6742270f-a084-4365-a862-6be3c53faaa5]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:33:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:48 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 Sep 08 07:33:48 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:48 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39" returned: 0 in 0.617s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:48 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39 Sep 08 07:33:48 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:48 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c0117455-85ca-45ac-b717-882022a44d39" returned: 0 in 0.436s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-quobyte-c0117455-85ca-45ac-b717-882022a44d39" released by "delete_volume" :: held 1.152s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Created reservations ['601cbe17-e78f-4880-b15d-96b7fb9f4b84', '84e6453d-80e2-41c4-a0c3-77bc63c81ba1', 'f220babc-6af5-43c9-90b2-549840e13d8c', 'eadf09d2-2b8c-4517-aa49-fef0ce75cb95'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:33:49 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:33:49 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:33:49 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.518s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:33:49 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Deleted volume successfully. Sep 08 07:33:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e9d84e64-7138-4201-a32b-d0021d39a4cd tempest-CreateVolumesFromSnapshotTest-1044489962 None] Lock "cinder-c0117455-85ca-45ac-b717-882022a44d39-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:33:59 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=142,cinder:SELECT=100,cinder:DELETE=10,cinder:INSERT=38 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:33:59 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=112,cinder:INSERT=30,cinder:UPDATE=126,cinder:DELETE=15 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:34:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-f57c8a56-69c0-4eec-b861-67bfbf8ba81c req-a37d7774-5993-43b2-98a5-12d134f84a7a tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-f57c8a56-69c0-4eec-b861-67bfbf8ba81c req-a37d7774-5993-43b2-98a5-12d134f84a7a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-f57c8a56-69c0-4eec-b861-67bfbf8ba81c req-a37d7774-5993-43b2-98a5-12d134f84a7a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-f57c8a56-69c0-4eec-b861-67bfbf8ba81c req-a37d7774-5993-43b2-98a5-12d134f84a7a tempest-TestInstancesWithCinderVolumes-709434118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-f9c8d050-7725-4a0d-9478-40ddb2627c17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48be99f8-e41d-4093-b3a2-8f5460057384', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:34:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-f57c8a56-69c0-4eec-b861-67bfbf8ba81c req-a37d7774-5993-43b2-98a5-12d134f84a7a tempest-TestInstancesWithCinderVolumes-709434118 None] attachment_update completed successfully. Sep 08 07:34:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-73075706-1d6d-453b-a95f-00602f922a07 req-9471f5e0-5786-423e-b108-a4af8118cbdb tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-73075706-1d6d-453b-a95f-00602f922a07 req-9471f5e0-5786-423e-b108-a4af8118cbdb tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-73075706-1d6d-453b-a95f-00602f922a07 req-9471f5e0-5786-423e-b108-a4af8118cbdb tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-73075706-1d6d-453b-a95f-00602f922a07 req-9471f5e0-5786-423e-b108-a4af8118cbdb tempest-TestInstancesWithCinderVolumes-709434118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5af4dac7-0977-49bf-bd4e-f6fa1964af88', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:34:16 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-73075706-1d6d-453b-a95f-00602f922a07 req-9471f5e0-5786-423e-b108-a4af8118cbdb tempest-TestInstancesWithCinderVolumes-709434118 None] attachment_update completed successfully. Sep 08 07:34:18 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-8f65415a-d51f-4a6b-aae0-6805b8a949df req-1cf5af69-05f5-46bb-a516-baa365469f9f tempest-TestMinimumBasicScenario-1351601952 None] Terminate volume connection completed successfully. Sep 08 07:34:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-8f65415a-d51f-4a6b-aae0-6805b8a949df req-1cf5af69-05f5-46bb-a516-baa365469f9f tempest-TestMinimumBasicScenario-1351601952 None] Deleting attachment a2d50ca7-bf88-4640-aab4-b9d25d96fc01. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:34:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Acquiring lock "cinder-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:34:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Lock "cinder-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:34:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Acquiring lock "cinder-quobyte-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:34:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Lock "cinder-quobyte-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:34:19 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[53659495-221c-4fb2-902f-89d323475052]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:34:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:19 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 Sep 08 07:34:19 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:19 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410" returned: 0 in 0.368s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:20 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410 Sep 08 07:34:20 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:20 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410" returned: 0 in 0.250s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Lock "cinder-quobyte-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410" released by "delete_volume" :: held 0.662s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Created reservations ['7d279eec-c51d-48ba-b6d6-c9fed6276ba6', '6aea8fc7-3f6c-4ebd-8062-617c294cccbc', '7907f243-3160-433d-8349-f36ac58c4508', '7980e634-73a6-4243-8fc8-40aa3e7c7fce'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:20 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:34:20 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:20 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.257s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:34:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Deleted volume successfully. Sep 08 07:34:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-202813ba-fbf9-40ed-83f4-b8468445f2ce tempest-TestMinimumBasicScenario-1351601952 None] Lock "cinder-4b0179e9-e5bc-4ea9-9120-14f7ab3fa410-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:34:21 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-3c1c5c2b-e89b-469b-a541-34306f53b28a req-91b9e58e-76b8-4074-a9e3-d5ee8c325856 tempest-TestInstancesWithCinderVolumes-709434118 None] Terminate volume connection completed successfully. Sep 08 07:34:21 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-3c1c5c2b-e89b-469b-a541-34306f53b28a req-91b9e58e-76b8-4074-a9e3-d5ee8c325856 tempest-TestInstancesWithCinderVolumes-709434118 None] Deleting attachment 48be99f8-e41d-4093-b3a2-8f5460057384. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "cinder-f9c8d050-7725-4a0d-9478-40ddb2627c17-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-f9c8d050-7725-4a0d-9478-40ddb2627c17-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "cinder-quobyte-f9c8d050-7725-4a0d-9478-40ddb2627c17" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-quobyte-f9c8d050-7725-4a0d-9478-40ddb2627c17" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a20217-2fc3-4cfc-bfa4-62fd16842311]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:22 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 Sep 08 07:34:22 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:22 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17" returned: 0 in 0.513s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:22 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17 Sep 08 07:34:22 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:22 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f9c8d050-7725-4a0d-9478-40ddb2627c17" returned: 0 in 0.293s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-quobyte-f9c8d050-7725-4a0d-9478-40ddb2627c17" released by "delete_volume" :: held 0.864s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:34:23 devstack cinder-volume[87278]: WARNING cinder.quota [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-722993795-2055843182 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-722993795-2055843182, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:34:23 devstack cinder-volume[87278]: WARNING cinder.quota [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-722993795-2055843182 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-722993795-2055843182, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Created reservations ['4b198daa-d46c-4644-984c-3841d7ad8ac6', '3e702a60-6f93-41e8-87cc-784960cb9e9f', 'a6c4f9d0-123c-4234-b5dd-5170a4a86458', '79016e3f-a089-4787-89b7-259b6eb6be90'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:23 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:34:23 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:23 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.276s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:34:23 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Deleted volume successfully. Sep 08 07:34:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5a2bdd2-5cc6-4512-9576-7348370dec7a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-f9c8d050-7725-4a0d-9478-40ddb2627c17-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:34:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-032f8013-3e8f-484c-a6c2-efd4d484c181 req-be2a9773-8227-4072-949c-769829bd2cfe tempest-TestInstancesWithCinderVolumes-709434118 None] Terminate volume connection completed successfully. Sep 08 07:34:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-032f8013-3e8f-484c-a6c2-efd4d484c181 req-be2a9773-8227-4072-949c-769829bd2cfe tempest-TestInstancesWithCinderVolumes-709434118 None] Deleting attachment 5af4dac7-0977-49bf-bd4e-f6fa1964af88. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:34:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "cinder-a23286c1-31ae-4021-9faa-05dbbf3ae8c9-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:34:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-a23286c1-31ae-4021-9faa-05dbbf3ae8c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:34:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "cinder-quobyte-a23286c1-31ae-4021-9faa-05dbbf3ae8c9" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:34:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-quobyte-a23286c1-31ae-4021-9faa-05dbbf3ae8c9" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:34:26 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[948b423f-a714-4adc-8114-895a2b01fff8]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:34:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:27 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 Sep 08 07:34:27 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:27 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9" returned: 0 in 0.477s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:27 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9 Sep 08 07:34:27 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:27 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a23286c1-31ae-4021-9faa-05dbbf3ae8c9" returned: 0 in 0.298s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-quobyte-a23286c1-31ae-4021-9faa-05dbbf3ae8c9" released by "delete_volume" :: held 0.828s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:34:27 devstack cinder-volume[87278]: WARNING cinder.quota [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-948355228-1088489774 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-948355228-1088489774, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:34:27 devstack cinder-volume[87278]: WARNING cinder.quota [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-948355228-1088489774 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-948355228-1088489774, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Created reservations ['f4ca78da-7169-4024-a992-71f16bcf9fb5', '3a89b8d3-bab1-43c0-9682-6ef48e0ad891', '770a4a94-0308-4a67-bbd4-d7fcbd5b100e', '848fda88-e712-4829-a0d1-0582526f133d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:27 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:34:27 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:28 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.314s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:28 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:34:28 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Deleted volume successfully. Sep 08 07:34:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-762dc995-8b17-499b-ba89-f9c6260b5858 tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-a23286c1-31ae-4021-9faa-05dbbf3ae8c9-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:34:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-e1edfed6-e1e0-4eca-9786-e987284435de req-0c15c826-02f5-4d5c-9366-c1c1f7730a90 tempest-TestInstancesWithCinderVolumes-709434118 None] Terminate volume connection completed successfully. Sep 08 07:34:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-e1edfed6-e1e0-4eca-9786-e987284435de req-0c15c826-02f5-4d5c-9366-c1c1f7730a90 tempest-TestInstancesWithCinderVolumes-709434118 None] Deleting attachment 8f517d48-f980-4d29-a636-41d9c261127a. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:34:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "cinder-7efca2c8-8521-44f3-b11e-e3725ef7c190-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:34:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-7efca2c8-8521-44f3-b11e-e3725ef7c190-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "cinder-quobyte-7efca2c8-8521-44f3-b11e-e3725ef7c190" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-quobyte-7efca2c8-8521-44f3-b11e-e3725ef7c190" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[204b1c17-5a01-4882-a70f-963ec92798fd]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:33 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 Sep 08 07:34:33 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:33 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190" returned: 0 in 0.393s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:33 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190 Sep 08 07:34:33 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:33 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7efca2c8-8521-44f3-b11e-e3725ef7c190" returned: 0 in 0.297s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-quobyte-7efca2c8-8521-44f3-b11e-e3725ef7c190" released by "delete_volume" :: held 0.728s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:34:33 devstack cinder-volume[87278]: WARNING cinder.quota [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1188053751-2133420889 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1188053751-2133420889, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:34:33 devstack cinder-volume[87278]: WARNING cinder.quota [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1188053751-2133420889 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1188053751-2133420889, it is now deprecated. Please use the default quota class for default quota. Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Created reservations ['9656858f-793e-4b5f-8850-eaadc7cd5339', 'c11f77f4-4baa-445b-a081-2f3f26f44745', 'dfcc5dc1-61f9-4c9b-a8af-e0d5636236f8', '5436005a-beb8-4db9-a174-ae9e63473439'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:33 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:34:33 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:34 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.254s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:34 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:34:34 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Deleted volume successfully. Sep 08 07:34:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-05fec7af-f1ef-4ad4-91de-74517bfcc53a tempest-TestInstancesWithCinderVolumes-709434118 None] Lock "cinder-7efca2c8-8521-44f3-b11e-e3725ef7c190-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:34:43 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=42,cinder:UPDATE=34,cinder:INSERT=9 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:34:44 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=32,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:34:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:34:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:34:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:34:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:44 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:34:44 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:45 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.346s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:34:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:34:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:34:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Flow 'volume_create_manager' (a0723a06-41fd-4cf5-a1f8-93064726353f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfb9c6b-cec2-47d8-884b-b5f27fe13f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfb9c6b-cec2-47d8-884b-b5f27fe13f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-686420579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f73e7bde833463ea136a3dc6c76f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:34:58Z,use_quota=True,user_id='13623a9f4fe945c181defc3ed0f8bb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80df066b-743e-4de9-8e23-712f41c8f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80df066b-743e-4de9-8e23-712f41c8f71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea3b24e-1841-4e9b-baca-030fbaea1c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea3b24e-1841-4e9b-baca-030fbaea1c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde', 'volume_name': 'volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3a2e38-a2df-4977-afe7-bc3d65dee914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3a2e38-a2df-4977-afe7-bc3d65dee914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a21c34-0a0f-407a-8ce7-3dd4c2bace11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:58 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Volume b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde', 'volume_size': 1} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-686420579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f73e7bde833463ea136a3dc6c76f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:34:58Z,use_quota=True,user_id='13623a9f4fe945c181defc3ed0f8bb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Creating volume b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:34:58 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:58 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde 1073741824 Sep 08 07:34:58 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:58 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Flow 'volume_create_manager' (858d8985-c955-4bf7-849d-7de8475a048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb519bf2-c8ca-467a-b3b1-a8f4b088594a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb519bf2-c8ca-467a-b3b1-a8f4b088594a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-425057006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a78d543-0b33-47e1-b4d7-34a49f93da58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f73e7bde833463ea136a3dc6c76f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:34:59Z,use_quota=True,user_id='13623a9f4fe945c181defc3ed0f8bb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf0d9bf-a3bb-4ff6-8258-bc0f19dc7754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf0d9bf-a3bb-4ff6-8258-bc0f19dc7754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348a6592-12b9-4428-a3b6-2be54fab4eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348a6592-12b9-4428-a3b6-2be54fab4eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a78d543-0b33-47e1-b4d7-34a49f93da58', 'volume_name': 'volume-6a78d543-0b33-47e1-b4d7-34a49f93da58', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545504ce-eeb4-4b67-8382-f1912d37126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545504ce-eeb4-4b67-8382-f1912d37126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d16160-69eb-4d9f-b048-a09e3de41af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:59 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Volume 6a78d543-0b33-47e1-b4d7-34a49f93da58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a78d543-0b33-47e1-b4d7-34a49f93da58', 'volume_size': 1} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:59 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde 1073741824" returned: 0 in 0.699s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:59 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde Sep 08 07:34:59 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:59 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde" returned: 0 in 0.291s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-425057006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a78d543-0b33-47e1-b4d7-34a49f93da58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f73e7bde833463ea136a3dc6c76f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:34:59Z,use_quota=True,user_id='13623a9f4fe945c181defc3ed0f8bb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Creating volume 6a78d543-0b33-47e1-b4d7-34a49f93da58 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:34:59 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:34:59 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 1073741824 Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a21c34-0a0f-407a-8ce7-3dd4c2bace11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:59 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1b5cde-b20c-42bb-bffc-dec8a82eb979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:34:59 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Volume volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde (b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde): created successfully Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1b5cde-b20c-42bb-bffc-dec8a82eb979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:34:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Flow 'volume_create_manager' (a0723a06-41fd-4cf5-a1f8-93064726353f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:34:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9e2eea23-0db7-4c05-b3f8-eb155cfd6273 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Created volume successfully. Sep 08 07:35:00 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 1073741824" returned: 0 in 0.586s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:00 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 Sep 08 07:35:00 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:00 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58" returned: 0 in 0.303s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:35:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d16160-69eb-4d9f-b048-a09e3de41af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a78d543-0b33-47e1-b4d7-34a49f93da58', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:35:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baaec5d1-d6fe-42d3-968e-69b1b56d5472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:35:00 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Volume volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 (6a78d543-0b33-47e1-b4d7-34a49f93da58): created successfully Sep 08 07:35:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baaec5d1-d6fe-42d3-968e-69b1b56d5472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:35:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Flow 'volume_create_manager' (858d8985-c955-4bf7-849d-7de8475a048a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:35:00 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bfcf9108-a0fa-463e-8fca-f1077a5bc326 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Created volume successfully. Sep 08 07:35:10 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:35:10 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Flow 'volume_create_manager' (99f68f57-14b9-415d-a7e6-fd5ad73286c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0663405f-a278-4935-aae4-b9327a929d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0663405f-a278-4935-aae4-b9327a929d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2125001409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8754b7-801f-472f-b00a-929341d7a5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce04762bb1f4a5ca634ae51491d55f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:35:14Z,use_quota=True,user_id='8bc3e731ea6f40669c48840221b0f31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf748ea-c116-46ec-a6a7-b9b3c9d3041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf748ea-c116-46ec-a6a7-b9b3c9d3041b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88fe87a-a853-45c7-a1d2-04151082c093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88fe87a-a853-45c7-a1d2-04151082c093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8754b7-801f-472f-b00a-929341d7a5d6', 'volume_name': 'volume-de8754b7-801f-472f-b00a-929341d7a5d6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c141954d-dd5c-4027-b67e-52ee221b936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c141954d-dd5c-4027-b67e-52ee221b936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3b5f92-cbb2-4779-aa6f-491eca6ac457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:35:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Volume de8754b7-801f-472f-b00a-929341d7a5d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8754b7-801f-472f-b00a-929341d7a5d6', 'volume_size': 1} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2125001409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8754b7-801f-472f-b00a-929341d7a5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce04762bb1f4a5ca634ae51491d55f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:35:14Z,use_quota=True,user_id='8bc3e731ea6f40669c48840221b0f31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Creating volume de8754b7-801f-472f-b00a-929341d7a5d6 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:35:14 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:14 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 1073741824 Sep 08 07:35:14 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:14 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 1073741824" returned: 0 in 0.408s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:14 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 Sep 08 07:35:14 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:14 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6" returned: 0 in 0.267s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3b5f92-cbb2-4779-aa6f-491eca6ac457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8754b7-801f-472f-b00a-929341d7a5d6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eecfb3d-4eb7-4afc-9d81-72821aab41f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:35:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Volume volume-de8754b7-801f-472f-b00a-929341d7a5d6 (de8754b7-801f-472f-b00a-929341d7a5d6): created successfully Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eecfb3d-4eb7-4afc-9d81-72821aab41f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:35:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Flow 'volume_create_manager' (99f68f57-14b9-415d-a7e6-fd5ad73286c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:35:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-814a6a17-6baa-4c5a-8909-ed8302dc746e tempest-TestImageHashVerification-524091413 None] Created volume successfully. Sep 08 07:35:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:35:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:35:15 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[035b6b75-b0ac-44a1-bb6e-7921c28dd82f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:35:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:15 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 Sep 08 07:35:15 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:16 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6" returned: 0 in 0.365s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:16 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff5f53-ef83-4207-bedb-a52495b4165a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:35:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:16 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 Sep 08 07:35:16 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:16 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6" returned: 0 in 0.372s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 /opt/stack/data/cinder/conversion/de8754b7-801f-472f-b00a-929341d7a5d6.temp_image.5c20a618-b21f-4e3e-ba4b-0e5a95ce8a4c8uty7nq6.img {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:16 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 /opt/stack/data/cinder/conversion/de8754b7-801f-472f-b00a-929341d7a5d6.temp_image.5c20a618-b21f-4e3e-ba4b-0e5a95ce8a4c8uty7nq6.img Sep 08 07:35:16 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:21 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 /opt/stack/data/cinder/conversion/de8754b7-801f-472f-b00a-929341d7a5d6.temp_image.5c20a618-b21f-4e3e-ba4b-0e5a95ce8a4c8uty7nq6.img" returned: 0 in 5.031s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:21 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b9c553-e3e4-483f-9a7c-f02c8a175e92]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:35:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:21 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 Sep 08 07:35:21 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:22 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6" returned: 0 in 0.551s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:22 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/conversion/de8754b7-801f-472f-b00a-929341d7a5d6.temp_image.5c20a618-b21f-4e3e-ba4b-0e5a95ce8a4c8uty7nq6.img {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:35:22 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Converted 1024.00 MB image at 203.48 MB/s Sep 08 07:35:22 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] 5c20a618-b21f-4e3e-ba4b-0e5a95ce8a4c was raw, no need to convert to raw {{(pid=87278) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 07:35:32 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:35:32 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:35:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-00d93ec0-e19b-436b-be34-784715800ef9 req-bf4fc91e-8ffb-4b3e-948b-83c03b2f722d tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:35:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.198s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Uploaded volume to glance image-id: 5c20a618-b21f-4e3e-ba4b-0e5a95ce8a4c. {{(pid=87278) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 07:35:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-00d93ec0-e19b-436b-be34-784715800ef9 req-bf4fc91e-8ffb-4b3e-948b-83c03b2f722d tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.494s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:35:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-00d93ec0-e19b-436b-be34-784715800ef9 req-bf4fc91e-8ffb-4b3e-948b-83c03b2f722d tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b9a21f23-ccac-439c-a0d9-0187b4a9f440 tempest-TestImageHashVerification-524091413 None] Copy volume to image completed successfully. Sep 08 07:35:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-00d93ec0-e19b-436b-be34-784715800ef9 req-bf4fc91e-8ffb-4b3e-948b-83c03b2f722d tempest-TestServerVolumeAttachmentScenario-2090069312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8610a707-e166-49d5-9346-2d793c650511', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:35:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-00d93ec0-e19b-436b-be34-784715800ef9 req-bf4fc91e-8ffb-4b3e-948b-83c03b2f722d tempest-TestServerVolumeAttachmentScenario-2090069312 None] attachment_update completed successfully. Sep 08 07:35:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Acquiring lock "cinder-de8754b7-801f-472f-b00a-929341d7a5d6-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:35:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Lock "cinder-de8754b7-801f-472f-b00a-929341d7a5d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:35:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Acquiring lock "cinder-quobyte-de8754b7-801f-472f-b00a-929341d7a5d6" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:35:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Lock "cinder-quobyte-de8754b7-801f-472f-b00a-929341d7a5d6" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:35:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade60b22-ac0b-411d-bb93-d90dcf116a8d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:35:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:42 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 Sep 08 07:35:42 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:42 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6" returned: 0 in 0.360s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:42 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6 Sep 08 07:35:42 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:42 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-de8754b7-801f-472f-b00a-929341d7a5d6" returned: 0 in 0.254s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Lock "cinder-quobyte-de8754b7-801f-472f-b00a-929341d7a5d6" released by "delete_volume" :: held 0.650s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Created reservations ['151a59f1-6815-4492-ab1d-0ec15cb91701', 'cf4249bc-b254-4256-b3bf-a30079f1d654', 'ee01acb4-80d6-4f0e-baed-2105cb743c88', 'a20229ae-9d9d-4eeb-8786-402b319d64ac'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:43 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:35:43 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:43 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.257s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:35:43 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Deleted volume successfully. Sep 08 07:35:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e90a72b3-9487-420b-a100-6339ae22906e tempest-TestImageHashVerification-524091413 None] Lock "cinder-de8754b7-801f-472f-b00a-929341d7a5d6-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:35:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:35:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:35:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:35:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:35:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:35:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:44 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:35:44 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:44 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.305s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:35:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:35:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:35:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:35:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-d986bc67-c69e-4978-a852-c4d8c27f003e req-bdb63cf9-2e8b-4bba-b0f8-26e5d931681d tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:35:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-d986bc67-c69e-4978-a852-c4d8c27f003e req-bdb63cf9-2e8b-4bba-b0f8-26e5d931681d tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:35:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-d986bc67-c69e-4978-a852-c4d8c27f003e req-bdb63cf9-2e8b-4bba-b0f8-26e5d931681d tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d986bc67-c69e-4978-a852-c4d8c27f003e req-bdb63cf9-2e8b-4bba-b0f8-26e5d931681d tempest-TestServerVolumeAttachmentScenario-2090069312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-6a78d543-0b33-47e1-b4d7-34a49f93da58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59ea4c9b-d401-4b61-94ab-d5dd3564599c', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:35:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-d986bc67-c69e-4978-a852-c4d8c27f003e req-bdb63cf9-2e8b-4bba-b0f8-26e5d931681d tempest-TestServerVolumeAttachmentScenario-2090069312 None] attachment_update completed successfully. Sep 08 07:35:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-d2ff4394-41fb-4406-9c7f-0f79b3451a97 req-e7e19771-836e-448e-a515-9ebc99886935 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Terminate volume connection completed successfully. Sep 08 07:35:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-d2ff4394-41fb-4406-9c7f-0f79b3451a97 req-e7e19771-836e-448e-a515-9ebc99886935 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Deleting attachment 59ea4c9b-d401-4b61-94ab-d5dd3564599c. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:35:48 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-294fbc00-e078-467b-bb4c-755a0e339b9b req-db810e82-ce77-4ed7-8cb6-79d8737fbf72 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Terminate volume connection completed successfully. Sep 08 07:35:48 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-294fbc00-e078-467b-bb4c-755a0e339b9b req-db810e82-ce77-4ed7-8cb6-79d8737fbf72 tempest-TestServerVolumeAttachmentScenario-2090069312 None] Deleting attachment 8610a707-e166-49d5-9346-2d793c650511. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:35:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "cinder-6a78d543-0b33-47e1-b4d7-34a49f93da58-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:35:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "cinder-6a78d543-0b33-47e1-b4d7-34a49f93da58-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "cinder-quobyte-6a78d543-0b33-47e1-b4d7-34a49f93da58" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "cinder-quobyte-6a78d543-0b33-47e1-b4d7-34a49f93da58" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d97bda-6fb4-4c0c-9e8f-6f47b48214d9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:54 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 Sep 08 07:35:54 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:54 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58" returned: 0 in 0.370s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:54 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58 Sep 08 07:35:54 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:54 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6a78d543-0b33-47e1-b4d7-34a49f93da58" returned: 0 in 0.254s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "cinder-quobyte-6a78d543-0b33-47e1-b4d7-34a49f93da58" released by "delete_volume" :: held 0.665s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Created reservations ['0cbbd721-10bf-48d2-9eaa-9191cfd5f58d', 'f965f400-c829-4f77-8c26-866a9ef22e9a', '067db47c-2ca8-4e9c-95bf-f0c0ab766509', '6cd30fe1-d70c-45a9-8dbb-7ed82fb7d6bb'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:54 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:35:54 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "cinder-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:35:55 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.277s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "cinder-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:35:55 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Deleted volume successfully. Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcee4c4a-367b-4308-8c08-dfb3a9c174be tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "cinder-6a78d543-0b33-47e1-b4d7-34a49f93da58-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "cinder-quobyte-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "cinder-quobyte-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde" acquired by "delete_volume" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c1e27-0a67-4709-b07c-a4af2514efd1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:55 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde Sep 08 07:35:55 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:55 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde" returned: 0 in 0.373s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:55 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde Sep 08 07:35:55 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:55 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde" returned: 0 in 0.270s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "cinder-quobyte-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde" released by "delete_volume" :: held 0.680s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:35:55 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Created reservations ['9f9c1661-8a52-486e-9b4b-92972c3c71de', 'aeda0e0c-c982-4f56-848c-3394a76c7bc6', 'e91037de-5c66-41ef-9045-bb7ca04f4a3b', 'ebc1d2de-af08-452b-a415-76b1cf0e9f20'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:35:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:35:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:35:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:35:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:35:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:35:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:35:56 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:35:56 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:35:56 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 08 07:35:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.284s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:35:56 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:35:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Deleted volume successfully. Sep 08 07:35:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-958d9073-9084-4e01-9852-590e58eb451e tempest-TestServerVolumeAttachmentScenario-2090069312 None] Lock "cinder-b3a3a55e-3e0f-4d3d-bb59-d51cf5accfde-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:36:06 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=33,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:36:06 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:36:15 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:36:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Flow 'volume_create_manager' (a0f7cf6e-67b3-4e98-89d8-d00fa22d9539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:36:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be09469-d4f5-4a32-8ba6-8251efcc45c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be09469-d4f5-4a32-8ba6-8251efcc45c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1832240954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcb55ab-7421-4b51-bd2f-be0f4755d0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff90b09b99c4663bc61a72f4b89138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:36:16Z,use_quota=True,user_id='459cdf0c803048e2a58d2a61fe382f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51745875-68cf-485a-b46f-572b1e5f2698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51745875-68cf-485a-b46f-572b1e5f2698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0153c7-39ff-4403-ac63-118f79b0f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0153c7-39ff-4403-ac63-118f79b0f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcb55ab-7421-4b51-bd2f-be0f4755d0fe', 'volume_name': 'volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c380593b-15c5-4cea-8362-114a56263af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c380593b-15c5-4cea-8362-114a56263af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2065981e-8135-40b9-9ff8-53f7cc7ca8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Volume 6fcb55ab-7421-4b51-bd2f-be0f4755d0fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe', 'volume_size': 1} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1832240954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcb55ab-7421-4b51-bd2f-be0f4755d0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff90b09b99c4663bc61a72f4b89138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:36:16Z,use_quota=True,user_id='459cdf0c803048e2a58d2a61fe382f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Creating volume 6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:36:16 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:16 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe 1073741824 Sep 08 07:36:16 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Flow 'volume_create_manager' (19eea685-9365-4408-b9c7-2cf5e1dc04db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afece6c-9c74-4a21-a2dc-a391f5139088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afece6c-9c74-4a21-a2dc-a391f5139088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b621c374-f282-4894-a61d-95b69d8b9d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d75e782304343d9aeb730214a790591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:36:16Z,use_quota=True,user_id='d2a21eaf56a84fc0a28de854d9e1785b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0db7bc-a902-42b5-8f20-d04f57ab0dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0db7bc-a902-42b5-8f20-d04f57ab0dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8884ac-0aab-45f3-9841-cf35fc1cac0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:36:16 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe 1073741824" returned: 0 in 0.585s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8884ac-0aab-45f3-9841-cf35fc1cac0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b621c374-f282-4894-a61d-95b69d8b9d34', 'volume_name': 'volume-b621c374-f282-4894-a61d-95b69d8b9d34', 'volume_size': 1, 'image_id': 'aa072135-f2a6-40df-b25a-057897530e4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa072135-f2a6-40df-b25a-057897530e4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79865e052386f2b458dafac11c484b61', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d75e782304343d9aeb730214a790591', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ac695f81626cfed708e64342934e5883366e0889414022a5fc79a0e88e0ee7d0ef521162afd720e48aa9656e34a220dc0649264025edc7d9b330d19c90d88e92', 'id': 'aa072135-f2a6-40df-b25a-057897530e4c', 'created_at': datetime.datetime(2026, 9, 8, 5, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa072135-f2a6-40df-b25a-057897530e4c/file', 'properties': {}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5b2d0b-8e1b-4f19-9721-51d995459561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5b2d0b-8e1b-4f19-9721-51d995459561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd78c01-5631-44e2-944b-b0c6e6003a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Volume b621c374-f282-4894-a61d-95b69d8b9d34: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b621c374-f282-4894-a61d-95b69d8b9d34', 'volume_size': 1, 'image_id': 'aa072135-f2a6-40df-b25a-057897530e4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa072135-f2a6-40df-b25a-057897530e4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79865e052386f2b458dafac11c484b61', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d75e782304343d9aeb730214a790591', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ac695f81626cfed708e64342934e5883366e0889414022a5fc79a0e88e0ee7d0ef521162afd720e48aa9656e34a220dc0649264025edc7d9b330d19c90d88e92', 'id': 'aa072135-f2a6-40df-b25a-057897530e4c', 'created_at': datetime.datetime(2026, 9, 8, 5, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa072135-f2a6-40df-b25a-057897530e4c/file', 'properties': {}}, 'image_service': } Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Trying to clone b621c374-f282-4894-a61d-95b69d8b9d34 from image aa072135-f2a6-40df-b25a-057897530e4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa072135-f2a6-40df-b25a-057897530e4c', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:16 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe Sep 08 07:36:16 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:36:16 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Image download 0.00 MB at 0.00 MB/s Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca634d7-8c7e-47c1-b04b-9b921b60280e]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:17 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" returned: 0 in 0.290s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2065981e-8135-40b9-9ff8-53f7cc7ca8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:17 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD Sep 08 07:36:17 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884fa030-d6d4-49ad-badc-15bb9697b145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Volume volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe (6fcb55ab-7421-4b51-bd2f-be0f4755d0fe): created successfully Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884fa030-d6d4-49ad-badc-15bb9697b145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Flow 'volume_create_manager' (a0f7cf6e-67b3-4e98-89d8-d00fa22d9539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:36:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fd85058b-8fae-428e-8ebe-6f8b0573ef06 tempest-TestStampPattern-1227368736 None] Created volume successfully. Sep 08 07:36:17 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:17 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD Sep 08 07:36:17 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:17 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Temporary image aa072135-f2a6-40df-b25a-057897530e4c is fetched for user d2a21eaf56a84fc0a28de854d9e1785b. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e861e-bc42-49eb-b7be-083b216b75de]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:17 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD Sep 08 07:36:17 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:18 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:18 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD Sep 08 07:36:18 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:18 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b621c374-f282-4894-a61d-95b69d8b9d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d75e782304343d9aeb730214a790591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:36:16Z,use_quota=True,user_id='d2a21eaf56a84fc0a28de854d9e1785b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Creating volume b621c374-f282-4894-a61d-95b69d8b9d34 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:36:18 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:18 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 1073741824 Sep 08 07:36:18 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:18 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 1073741824" returned: 0 in 0.502s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:19 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 Sep 08 07:36:19 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:19 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34" returned: 0 in 0.347s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:36:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:19 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Attempting download of aa072135-f2a6-40df-b25a-057897530e4c ((None, [{'url': 'file:///opt/stack/data/glance/images/aa072135-f2a6-40df-b25a-057897530e4c', 'metadata': {}}])) to volume b621c374-f282-4894-a61d-95b69d8b9d34. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:36:19 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[126719f8-a9e2-4212-9b81-8ac00d5539e6]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa072135-f2a6-40df-b25a-057897530e4c_g7j_15x3 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:19 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa072135-f2a6-40df-b25a-057897530e4c_g7j_15x3 Sep 08 07:36:19 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:19 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa072135-f2a6-40df-b25a-057897530e4c_g7j_15x3" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa072135-f2a6-40df-b25a-057897530e4c_g7j_15x3 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:19 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa072135-f2a6-40df-b25a-057897530e4c_g7j_15x3 Sep 08 07:36:19 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:20 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa072135-f2a6-40df-b25a-057897530e4c_g7j_15x3" returned: 1 in 0.336s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa072135-f2a6-40df-b25a-057897530e4c_g7j_15x3' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2669659d-68ff-4f60-a315-36f235c80377]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:20 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD Sep 08 07:36:20 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:20 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:20 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD Sep 08 07:36:20 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:20 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] aa072135-f2a6-40df-b25a-057897530e4c was raw, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:36:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:20 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 Sep 08 07:36:20 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:21 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34" returned: 0 in 0.810s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:21 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa072135-f2a6-40df-b25a-057897530e4c_g1y4vckrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:36:21 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 07:36:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:21 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 1G Sep 08 07:36:21 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:22 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 1G" returned: 0 in 0.448s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Downloaded image aa072135-f2a6-40df-b25a-057897530e4c ((None, [{'url': 'file:///opt/stack/data/glance/images/aa072135-f2a6-40df-b25a-057897530e4c', 'metadata': {}}])) to volume b621c374-f282-4894-a61d-95b69d8b9d34 successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Temporary image aa072135-f2a6-40df-b25a-057897530e4c for user d2a21eaf56a84fc0a28de854d9e1785b is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Marking volume b621c374-f282-4894-a61d-95b69d8b9d34 as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Copying metadata from image aa072135-f2a6-40df-b25a-057897530e4c to b621c374-f282-4894-a61d-95b69d8b9d34. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Creating volume glance metadata for volume b621c374-f282-4894-a61d-95b69d8b9d34 backed by image aa072135-f2a6-40df-b25a-057897530e4c with: {'image_id': 'aa072135-f2a6-40df-b25a-057897530e4c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '79865e052386f2b458dafac11c484b61', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd78c01-5631-44e2-944b-b0c6e6003a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b621c374-f282-4894-a61d-95b69d8b9d34', 'volume_size': 1, 'image_id': 'aa072135-f2a6-40df-b25a-057897530e4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa072135-f2a6-40df-b25a-057897530e4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79865e052386f2b458dafac11c484b61', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d75e782304343d9aeb730214a790591', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ac695f81626cfed708e64342934e5883366e0889414022a5fc79a0e88e0ee7d0ef521162afd720e48aa9656e34a220dc0649264025edc7d9b330d19c90d88e92', 'id': 'aa072135-f2a6-40df-b25a-057897530e4c', 'created_at': datetime.datetime(2026, 9, 8, 5, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa072135-f2a6-40df-b25a-057897530e4c/file', 'properties': {}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd67d055-2d32-490d-9ca2-aa2307286451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:22 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Volume volume-b621c374-f282-4894-a61d-95b69d8b9d34 (b621c374-f282-4894-a61d-95b69d8b9d34): created successfully Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd67d055-2d32-490d-9ca2-aa2307286451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Flow 'volume_create_manager' (19eea685-9365-4408-b9c7-2cf5e1dc04db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:36:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0c28ec4e-772b-4281-a8d9-f27d42f41df3 tempest-VolumeImageDependencyTests-1821154672 None] Created volume successfully. Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Acquiring lock "cinder-b621c374-f282-4894-a61d-95b69d8b9d34-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Lock "cinder-b621c374-f282-4894-a61d-95b69d8b9d34-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Acquiring lock "cinder-quobyte-b621c374-f282-4894-a61d-95b69d8b9d34" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Lock "cinder-quobyte-b621c374-f282-4894-a61d-95b69d8b9d34" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[682722d5-a2df-46c1-abff-7a11d87e60b2]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:23 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 Sep 08 07:36:23 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:23 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34" returned: 0 in 0.445s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:23 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34 Sep 08 07:36:23 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:23 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b621c374-f282-4894-a61d-95b69d8b9d34" returned: 0 in 0.285s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Lock "cinder-quobyte-b621c374-f282-4894-a61d-95b69d8b9d34" released by "delete_volume" :: held 0.782s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Created reservations ['63da1a64-82a6-4ea3-ab9d-cde0ab55b136', '9a6ccdcf-507e-4ea8-9a1d-1d277178c93f', '4595a3cc-d8eb-4641-a38a-144e47239608', 'e920be95-fabe-4093-8d9a-fd56f8b2b5ad'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:23 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:36:23 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:24 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.315s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:24 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:36:24 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Deleted volume successfully. Sep 08 07:36:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-cf5fe947-5e4b-48b8-ba2c-3f1e761bac32 tempest-VolumeImageDependencyTests-1821154672 None] Lock "cinder-b621c374-f282-4894-a61d-95b69d8b9d34-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:36:33 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=18,cinder:UPDATE=12,cinder:INSERT=8 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:36:34 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=11,cinder:UPDATE=19,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:44 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:36:44 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:44 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:36:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Flow 'volume_create_manager' (5891b991-c288-41bd-a256-31545fdd26a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a344d6-caee-4f09-8f7b-b999df96eaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a344d6-caee-4f09-8f7b-b999df96eaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-681723444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773b2cad-c3f9-4d55-a398-1b73c2c0c9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c85087a925442cdb7782dccb3ac6ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:36:46Z,use_quota=True,user_id='46c199ca8ec446e7b834576ffe5f5a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf130a9-ca1b-4f6c-b6bd-64e0b0494fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf130a9-ca1b-4f6c-b6bd-64e0b0494fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84802721-cd69-4c87-81e4-eda24b5d31ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84802721-cd69-4c87-81e4-eda24b5d31ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773b2cad-c3f9-4d55-a398-1b73c2c0c9af', 'volume_name': 'volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ba9bb8-fe38-47f8-9b45-46638e0a4271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ba9bb8-fe38-47f8-9b45-46638e0a4271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5a6aa4-1be1-4429-8164-2b7a86b6f3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:46 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Volume 773b2cad-c3f9-4d55-a398-1b73c2c0c9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af', 'volume_size': 1} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-681723444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773b2cad-c3f9-4d55-a398-1b73c2c0c9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c85087a925442cdb7782dccb3ac6ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:36:46Z,use_quota=True,user_id='46c199ca8ec446e7b834576ffe5f5a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Creating volume 773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:36:46 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:46 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af 1073741824 Sep 08 07:36:46 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:46 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af 1073741824" returned: 0 in 0.476s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:46 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af Sep 08 07:36:46 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:47 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" returned: 0 in 0.256s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5a6aa4-1be1-4429-8164-2b7a86b6f3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093f0e4c-80ae-4d6f-90ea-525fe6d37557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:47 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Volume volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af (773b2cad-c3f9-4d55-a398-1b73c2c0c9af): created successfully Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093f0e4c-80ae-4d6f-90ea-525fe6d37557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Flow 'volume_create_manager' (5891b991-c288-41bd-a256-31545fdd26a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:36:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-411c19b4-8261-4dd7-a9e5-749022e0b978 tempest-SnapshotDependencyTests-1529346931 None] Created volume successfully. Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-22eb478d-af38-4d3a-9638-d07e181af64c req-079c6b6b-3463-4305-b7b8-0004548b14ff tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-22eb478d-af38-4d3a-9638-d07e181af64c req-079c6b6b-3463-4305-b7b8-0004548b14ff tempest-TestStampPattern-1227368736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-22eb478d-af38-4d3a-9638-d07e181af64c req-079c6b6b-3463-4305-b7b8-0004548b14ff tempest-TestStampPattern-1227368736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-22eb478d-af38-4d3a-9638-d07e181af64c req-079c6b6b-3463-4305-b7b8-0004548b14ff tempest-TestStampPattern-1227368736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '758c3981-95a8-4f6a-a0c5-0fc9f89f687c', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:36:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-22eb478d-af38-4d3a-9638-d07e181af64c req-079c6b6b-3463-4305-b7b8-0004548b14ff tempest-TestStampPattern-1227368736 None] attachment_update completed successfully. Sep 08 07:36:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Creating offline snapshot 59b737ef-75ab-46fb-92a7-e948ebb50ce9 of volume 773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:36:48 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f44d4b1-7ff9-4c90-b804-2d195df59c0c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:48 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af Sep 08 07:36:48 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:48 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" returned: 0 in 0.374s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:48 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 1G Sep 08 07:36:48 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:49 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 1G" returned: 0 in 0.400s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:49 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 Sep 08 07:36:49 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:49 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9" returned: 0 in 0.309s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:49 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 is being set with open permissions: ugo+rw Sep 08 07:36:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:49 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 Sep 08 07:36:49 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:49 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9" returned: 0 in 0.268s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:49 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.info Sep 08 07:36:49 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:50 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.info" returned: 0 in 0.255s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:50 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.info is being set with open permissions: ugo+rw Sep 08 07:36:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:50 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.info Sep 08 07:36:50 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:50 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.info" returned: 0 in 0.243s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:50 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-dc63c0ac-c5a6-4f67-b758-6917a17ac39a tempest-SnapshotDependencyTests-1529346931 None] Create snapshot completed successfully Sep 08 07:36:51 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-33400ce5-a56c-4cd8-b490-a46a606efa83 req-7506e1f1-57c5-4bb1-8520-6e1ce1d43cca tempest-TestStampPattern-1227368736 None] Terminate volume connection completed successfully. Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-33400ce5-a56c-4cd8-b490-a46a606efa83 req-7506e1f1-57c5-4bb1-8520-6e1ce1d43cca tempest-TestStampPattern-1227368736 None] Deleting attachment 758c3981-95a8-4f6a-a0c5-0fc9f89f687c. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Flow 'volume_create_manager' (db80b627-b8fc-447d-be41-f79dd7f33785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dea2642-0c71-49fe-9561-4a81c2d437e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dea2642-0c71-49fe-9561-4a81c2d437e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2b84fc-6e42-43f5-a0da-8d64c4a6872a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c85087a925442cdb7782dccb3ac6ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59b737ef-75ab-46fb-92a7-e948ebb50ce9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:36:51Z,use_quota=True,user_id='46c199ca8ec446e7b834576ffe5f5a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4259c6ab-8d72-4073-9bd4-92d0deb2b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4259c6ab-8d72-4073-9bd4-92d0deb2b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3d6bfa-63fc-4b3c-90bf-46d74b9dc4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3d6bfa-63fc-4b3c-90bf-46d74b9dc4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c2b84fc-6e42-43f5-a0da-8d64c4a6872a', 'volume_name': 'volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a', 'volume_size': 1, 'snapshot_id': '59b737ef-75ab-46fb-92a7-e948ebb50ce9'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff436c5a-8722-47bd-9a35-b4b9dcba5288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff436c5a-8722-47bd-9a35-b4b9dcba5288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb125bc-511a-4e37-986c-5d6f7d2c3be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:51 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Volume 5c2b84fc-6e42-43f5-a0da-8d64c4a6872a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a', 'volume_size': 1, 'snapshot_id': '59b737ef-75ab-46fb-92a7-e948ebb50ce9'} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "cinder-quobyte-59b737ef-75ab-46fb-92a7-e948ebb50ce9-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" by "_create_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-59b737ef-75ab-46fb-92a7-e948ebb50ce9-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Creating volume 5c2b84fc-6e42-43f5-a0da-8d64c4a6872a from snapshot 59b737ef-75ab-46fb-92a7-e948ebb50ce9 {{(pid=87278) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "cinder-quobyte-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] snapshot: 59b737ef-75ab-46fb-92a7-e948ebb50ce9, volume: 5c2b84fc-6e42-43f5-a0da-8d64c4a6872a, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[692dfdf2-f9eb-4ac6-bac6-6a491048258a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:51 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 Sep 08 07:36:51 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:51 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9" returned: 0 in 0.373s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[639b9d97-2bbd-44df-b652-cc8192018426]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:51 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af Sep 08 07:36:51 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:52 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" returned: 0 in 0.378s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:36:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:36:52 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:36:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:52 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a Sep 08 07:36:52 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:56 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" returned: 0 in 4.010s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:36:56 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Converted 1024.00 MB image at 255.27 MB/s Sep 08 07:36:56 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a is being set with open permissions: ugo+rw Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:56 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a Sep 08 07:36:56 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:56 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" returned: 0 in 0.244s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" released by "_copy_volume_from_snapshot" :: held 5.083s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-59b737ef-75ab-46fb-92a7-e948ebb50ce9-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" released by "_create_volume_from_snapshot" :: held 5.147s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.163s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.467s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Creating offline snapshot 9e942b6c-6693-4653-bda4-d02c472eca1d of volume 6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb125bc-511a-4e37-986c-5d6f7d2c3be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a', 'volume_size': 1, 'snapshot_id': '59b737ef-75ab-46fb-92a7-e948ebb50ce9'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf804b4-3e6e-4727-87ca-e3f9c8780ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97006f0-3984-4295-9f7e-2bba1fe0d892]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:56 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Volume volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a (5c2b84fc-6e42-43f5-a0da-8d64c4a6872a): created successfully Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf804b4-3e6e-4727-87ca-e3f9c8780ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Flow 'volume_create_manager' (db80b627-b8fc-447d-be41-f79dd7f33785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:36:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-27536cd6-ed9c-48b6-803d-194da02dda50 tempest-SnapshotDependencyTests-1529346931 None] Created volume successfully. Sep 08 07:36:56 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe Sep 08 07:36:56 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "cinder-59b737ef-75ab-46fb-92a7-e948ebb50ce9-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-59b737ef-75ab-46fb-92a7-e948ebb50ce9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "cinder-quobyte-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "cinder-quobyte-59b737ef-75ab-46fb-92a7-e948ebb50ce9" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-59b737ef-75ab-46fb-92a7-e948ebb50ce9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Deleting offline snapshot 59b737ef-75ab-46fb-92a7-e948ebb50ce9 of volume 773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] snapshot_file for this snap is: volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bac3e4-475d-4079-9b74-1f5d2261eb10]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:56 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" returned: 0 in 0.381s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:57 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d 1G Sep 08 07:36:57 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:57 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 Sep 08 07:36:57 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:57 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9" returned: 0 in 0.374s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdb1c40-e755-40b5-b9b2-6e2b95997fc1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:57 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d 1G" returned: 0 in 0.393s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:57 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d Sep 08 07:36:57 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:57 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af Sep 08 07:36:57 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:57 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d" returned: 0 in 0.298s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:57 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d is being set with open permissions: ugo+rw Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:57 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d Sep 08 07:36:57 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:57 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" returned: 0 in 0.543s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:57 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d" returned: 0 in 0.255s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:57 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 Sep 08 07:36:57 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:57 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.info Sep 08 07:36:57 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:58 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.info" returned: 0 in 0.243s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:58 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.info is being set with open permissions: ugo+rw Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:58 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.info Sep 08 07:36:58 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:58 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:58 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9 Sep 08 07:36:58 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:58 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.info" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:58 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af.59b737ef-75ab-46fb-92a7-e948ebb50ce9" returned: 0 in 0.254s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:58 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b4bc2c1b-538a-4d44-a5bc-5d8da3979c38 tempest-TestStampPattern-1227368736 None] Create snapshot completed successfully Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-59b737ef-75ab-46fb-92a7-e948ebb50ce9" released by "_delete_snapshot" :: held 1.598s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" released by "delete_snapshot" :: held 1.638s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Created reservations ['b816e8ff-aadb-416c-86f7-add63feeae02', '305a6db7-b2f1-4efa-aaa5-6629097a676c', 'f0f5312b-5112-4003-bb24-c8381d08649c', '3374403b-a245-4a70-8d7e-454e8bb762bc'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:36:58 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Delete snapshot completed successfully. Sep 08 07:36:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e5da8120-c8ad-4a9c-8261-4b840095eb45 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-59b737ef-75ab-46fb-92a7-e948ebb50ce9-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "cinder-773b2cad-c3f9-4d55-a398-1b73c2c0c9af-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-773b2cad-c3f9-4d55-a398-1b73c2c0c9af-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "cinder-quobyte-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[938b3df5-23d0-4051-a259-021215e4adb1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:59 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af Sep 08 07:36:59 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:59 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" returned: 0 in 0.376s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:59 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af Sep 08 07:36:59 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:36:59 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" returned: 0 in 0.251s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-773b2cad-c3f9-4d55-a398-1b73c2c0c9af" released by "delete_volume" :: held 0.683s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Created reservations ['81eb537f-cd4c-429c-828f-e44536970728', '19a85f33-4a73-4d2c-9369-cebce3e2b5c2', '0564059d-070f-479c-92f5-f356fa109e2b', 'ad94e059-2457-416d-bc4f-f69115a2f6d7'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:36:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:36:59 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:36:59 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:37:00 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.262s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:37:00 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Deleted volume successfully. Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4e56524f-289d-4e71-9e26-7ab8de00c9a8 tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-773b2cad-c3f9-4d55-a398-1b73c2c0c9af-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "cinder-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "cinder-quobyte-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ed1ecf-466c-49ce-b940-4bafb064f4fb]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:37:00 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a Sep 08 07:37:00 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:37:00 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" returned: 0 in 0.398s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:37:00 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a Sep 08 07:37:00 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:37:00 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" returned: 0 in 0.256s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:37:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-quobyte-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a" released by "delete_volume" :: held 0.700s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Created reservations ['58f30c6d-f196-486d-8398-dd82abd84e14', 'f150accc-c9ad-415e-8174-f552691c5130', '6d1d09be-573a-4113-886f-2991aea1b777', '12b003a6-dde0-4645-89ea-bb05451a5849'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:37:01 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:37:01 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:37:01 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.268s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:37:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Deleted volume successfully. Sep 08 07:37:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6ad91c9d-015b-47d9-8db4-be6c447c975f tempest-SnapshotDependencyTests-1529346931 None] Lock "cinder-5c2b84fc-6e42-43f5-a0da-8d64c4a6872a-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Flow 'volume_create_manager' (30f0a572-a1c2-4d1c-a3fa-c62a3684d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408612dd-d5ee-436d-908f-c5d94bb23415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408612dd-d5ee-436d-908f-c5d94bb23415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1294896489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e4a01d-4563-4e25-a705-7395c8e14259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff90b09b99c4663bc61a72f4b89138b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e942b6c-6693-4653-bda4-d02c472eca1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:37:06Z,use_quota=True,user_id='459cdf0c803048e2a58d2a61fe382f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373b6362-0d25-4096-8904-b7babb0a66cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373b6362-0d25-4096-8904-b7babb0a66cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70d9d47-f773-4de1-9ce0-7be38617d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70d9d47-f773-4de1-9ce0-7be38617d61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35e4a01d-4563-4e25-a705-7395c8e14259', 'volume_name': 'volume-35e4a01d-4563-4e25-a705-7395c8e14259', 'volume_size': 1, 'snapshot_id': '9e942b6c-6693-4653-bda4-d02c472eca1d'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40daad5d-fe8c-428a-8199-d6c3efb25e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40daad5d-fe8c-428a-8199-d6c3efb25e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecc8d32-ae25-47af-a230-86a6a5cb0b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:37:06 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Volume 35e4a01d-4563-4e25-a705-7395c8e14259: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35e4a01d-4563-4e25-a705-7395c8e14259', 'volume_size': 1, 'snapshot_id': '9e942b6c-6693-4653-bda4-d02c472eca1d'} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Acquiring lock "cinder-quobyte-9e942b6c-6693-4653-bda4-d02c472eca1d-35e4a01d-4563-4e25-a705-7395c8e14259" by "_create_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-9e942b6c-6693-4653-bda4-d02c472eca1d-35e4a01d-4563-4e25-a705-7395c8e14259" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Creating volume 35e4a01d-4563-4e25-a705-7395c8e14259 from snapshot 9e942b6c-6693-4653-bda4-d02c472eca1d {{(pid=87278) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Acquiring lock "cinder-quobyte-35e4a01d-4563-4e25-a705-7395c8e14259" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-35e4a01d-4563-4e25-a705-7395c8e14259" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] snapshot: 9e942b6c-6693-4653-bda4-d02c472eca1d, volume: 35e4a01d-4563-4e25-a705-7395c8e14259, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b017dac-4cc5-469a-a104-bf3085021a93]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:37:06 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d Sep 08 07:37:06 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:37:06 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d" returned: 0 in 0.389s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4329e314-c3c6-4682-8cf0-566ad6c0c7d4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:37:06 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:37:07 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe Sep 08 07:37:07 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:37:07 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 08 07:37:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" returned: 0 in 0.473s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:37:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:37:07 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:37:07 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:37:07 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:37:07 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 Sep 08 07:37:07 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:37:13 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 08 07:37:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259" returned: 0 in 6.269s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:37:13 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:37:13 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Converted 1024.00 MB image at 163.27 MB/s Sep 08 07:37:13 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 is being set with open permissions: ugo+rw Sep 08 07:37:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:37:13 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 Sep 08 07:37:13 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:37:14 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 08 07:37:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259" returned: 0 in 0.368s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:37:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-35e4a01d-4563-4e25-a705-7395c8e14259" released by "_copy_volume_from_snapshot" :: held 7.604s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:37:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-9e942b6c-6693-4653-bda4-d02c472eca1d-35e4a01d-4563-4e25-a705-7395c8e14259" released by "_create_volume_from_snapshot" :: held 7.706s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:37:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.730s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:37:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecc8d32-ae25-47af-a230-86a6a5cb0b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e4a01d-4563-4e25-a705-7395c8e14259', 'volume_size': 1, 'snapshot_id': '9e942b6c-6693-4653-bda4-d02c472eca1d'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:37:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d352774f-8bdf-4ff3-9429-8a42d8d5936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:37:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Volume volume-35e4a01d-4563-4e25-a705-7395c8e14259 (35e4a01d-4563-4e25-a705-7395c8e14259): created successfully Sep 08 07:37:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d352774f-8bdf-4ff3-9429-8a42d8d5936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:37:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Flow 'volume_create_manager' (30f0a572-a1c2-4d1c-a3fa-c62a3684d85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:37:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a0c7aba0-0a52-4e4e-99ba-ef7890ea8092 tempest-TestStampPattern-1227368736 None] Created volume successfully. Sep 08 07:37:24 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=38,cinder:SELECT=38,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:37:24 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=41,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:37:44 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:37:44 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:37:44 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.250s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:37:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:37:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-2587edf7-3f50-4f80-9791-e1965b00344e req-e5a86b08-91c5-4688-a4fd-ff9f3e67b91d tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:37:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-2587edf7-3f50-4f80-9791-e1965b00344e req-e5a86b08-91c5-4688-a4fd-ff9f3e67b91d tempest-TestStampPattern-1227368736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:37:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [req-2587edf7-3f50-4f80-9791-e1965b00344e req-e5a86b08-91c5-4688-a4fd-ff9f3e67b91d tempest-TestStampPattern-1227368736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:37:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-2587edf7-3f50-4f80-9791-e1965b00344e req-e5a86b08-91c5-4688-a4fd-ff9f3e67b91d tempest-TestStampPattern-1227368736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622', 'name': 'volume-35e4a01d-4563-4e25-a705-7395c8e14259', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0654d628-d00f-4606-99cf-f0ee5a32be52', 'enforce_multipath': True} {{(pid=87278) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 07:37:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-2587edf7-3f50-4f80-9791-e1965b00344e req-e5a86b08-91c5-4688-a4fd-ff9f3e67b91d tempest-TestStampPattern-1227368736 None] attachment_update completed successfully. Sep 08 07:37:58 devstack cinder-volume[87278]: INFO cinder.volume.manager [req-96b71ce2-38ce-4481-bed6-7c6334397c73 req-51c3b441-fa8f-4785-ad62-0064c5e0f0e8 tempest-TestStampPattern-1227368736 None] Terminate volume connection completed successfully. Sep 08 07:37:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [req-96b71ce2-38ce-4481-bed6-7c6334397c73 req-51c3b441-fa8f-4785-ad62-0064c5e0f0e8 tempest-TestStampPattern-1227368736 None] Deleting attachment 0654d628-d00f-4606-99cf-f0ee5a32be52. {{(pid=87278) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 07:38:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Acquiring lock "cinder-35e4a01d-4563-4e25-a705-7395c8e14259-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Lock "cinder-35e4a01d-4563-4e25-a705-7395c8e14259-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Acquiring lock "cinder-quobyte-35e4a01d-4563-4e25-a705-7395c8e14259" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-35e4a01d-4563-4e25-a705-7395c8e14259" acquired by "delete_volume" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b936d5-67ac-4d81-9559-0c9728225bc8]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:03 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 Sep 08 07:38:03 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:03 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259" returned: 0 in 0.354s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:03 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259 Sep 08 07:38:03 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:03 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-35e4a01d-4563-4e25-a705-7395c8e14259" returned: 0 in 0.248s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-35e4a01d-4563-4e25-a705-7395c8e14259" released by "delete_volume" :: held 0.638s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Created reservations ['76f05f94-5eee-4a9a-b31d-d7e3fd9199c3', 'bbb147fe-315d-44db-a8b1-9abc4f25497a', 'da71ce57-2063-421c-a7a3-6875aff39ec9', '67e73389-b980-437d-aed0-e74f9042812c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:03 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:03 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:04 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Deleted volume successfully. Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f5a166b-7624-41a2-9665-523f55be164c tempest-TestStampPattern-1227368736 None] Lock "cinder-35e4a01d-4563-4e25-a705-7395c8e14259-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Acquiring lock "cinder-9e942b6c-6693-4653-bda4-d02c472eca1d-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Lock "cinder-9e942b6c-6693-4653-bda4-d02c472eca1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Acquiring lock "cinder-quobyte-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Acquiring lock "cinder-quobyte-9e942b6c-6693-4653-bda4-d02c472eca1d" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-9e942b6c-6693-4653-bda4-d02c472eca1d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Deleting offline snapshot 9e942b6c-6693-4653-bda4-d02c472eca1d of volume 6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] snapshot_file for this snap is: volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da48a42-c647-4a5a-b30b-d1bb0887d3e2]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:04 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d Sep 08 07:38:04 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:04 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d" returned: 0 in 0.357s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[040bb2f6-5e69-42c8-a3f9-d83e858126a1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:04 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe Sep 08 07:38:04 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:05 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" returned: 0 in 0.519s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:05 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d Sep 08 07:38:05 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:05 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d" returned: 0 in 0.334s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:05 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d Sep 08 07:38:05 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:05 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe.9e942b6c-6693-4653-bda4-d02c472eca1d" returned: 0 in 0.242s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-9e942b6c-6693-4653-bda4-d02c472eca1d" released by "_delete_snapshot" :: held 1.546s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" released by "delete_snapshot" :: held 1.567s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:06 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Created reservations ['13d0cd18-b5a5-4403-9d56-9876a453ac03', '67ace166-205e-445c-9c0c-bdf87458e7e7', '44dac8b2-9145-4a93-921a-9e3862d5d810', '618abb9c-9821-43d8-8a90-3fb8f9ad418a'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:06 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Delete snapshot completed successfully. Sep 08 07:38:06 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6a2d3e4d-7dff-4390-b5cf-1aebba8c4729 tempest-TestStampPattern-1227368736 None] Lock "cinder-9e942b6c-6693-4653-bda4-d02c472eca1d-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Acquiring lock "cinder-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Lock "cinder-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Acquiring lock "cinder-quobyte-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" acquired by "delete_volume" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c4e09b-1785-47a8-8333-e332548773ec]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:10 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe Sep 08 07:38:10 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:10 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" returned: 0 in 0.369s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:10 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe Sep 08 07:38:10 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:10 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" returned: 0 in 0.245s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Lock "cinder-quobyte-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe" released by "delete_volume" :: held 0.666s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Created reservations ['e0171f10-14da-466d-b96b-67c3e7644216', '245667d8-0aba-4a2b-bd4b-3df7e5f700ab', '32cdfa54-ec52-4303-85fe-3417871eef47', '8d827bc8-4de4-4446-998c-61d9b2ed4fd2'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:10 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:10 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:11 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.244s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:11 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:11 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Deleted volume successfully. Sep 08 07:38:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-fcb1502c-8998-4ac9-9c28-45dc47d41a6b tempest-TestStampPattern-1227368736 None] Lock "cinder-6fcb55ab-7421-4b51-bd2f-be0f4755d0fe-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:20 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:38:21 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=25,cinder:UPDATE=21,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (9e306e3d-6412-49f8-9908-e86f79ecc878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba87ec89-def4-48b2-8cb7-173c872fceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba87ec89-def4-48b2-8cb7-173c872fceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411452555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8a6408-066d-4020-9e4c-97f562e086a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:22Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5971362-4640-41a9-b5bb-2c6503c1d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5971362-4640-41a9-b5bb-2c6503c1d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ffc106-50d4-4739-a88c-aa34a61b39ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ffc106-50d4-4739-a88c-aa34a61b39ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8a6408-066d-4020-9e4c-97f562e086a6', 'volume_name': 'volume-9e8a6408-066d-4020-9e4c-97f562e086a6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d057e76-0538-4786-a822-39ed891fb1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d057e76-0538-4786-a822-39ed891fb1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d19c3e6-cbe4-41e5-97fb-c1d7aee88e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:22 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume 9e8a6408-066d-4020-9e4c-97f562e086a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8a6408-066d-4020-9e4c-97f562e086a6', 'volume_size': 1} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411452555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8a6408-066d-4020-9e4c-97f562e086a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:22Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Creating volume 9e8a6408-066d-4020-9e4c-97f562e086a6 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:22 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:22 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6 1073741824 Sep 08 07:38:22 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:22 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6 1073741824" returned: 0 in 0.409s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:22 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6 Sep 08 07:38:22 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:22 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d19c3e6-cbe4-41e5-97fb-c1d7aee88e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8a6408-066d-4020-9e4c-97f562e086a6', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d73e91-9761-4f65-8ab9-a565ceb2e451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:22 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume volume-9e8a6408-066d-4020-9e4c-97f562e086a6 (9e8a6408-066d-4020-9e4c-97f562e086a6): created successfully Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d73e91-9761-4f65-8ab9-a565ceb2e451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (9e306e3d-6412-49f8-9908-e86f79ecc878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a8156cd6-87fc-4b12-b976-84a1592cda2d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created volume successfully. Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (83901204-5339-4e9c-9d40-1e0199dc07ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d14d30-0bd8-4f60-8e0f-d1e755774d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d14d30-0bd8-4f60-8e0f-d1e755774d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146049852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8761cbd0-b10e-47a5-969f-59fa384d5cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:23Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fe0e89-3695-41ba-8c77-e4ac1d414631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fe0e89-3695-41ba-8c77-e4ac1d414631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567e2e90-3106-41c2-942e-9091185e2e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567e2e90-3106-41c2-942e-9091185e2e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8761cbd0-b10e-47a5-969f-59fa384d5cb3', 'volume_name': 'volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d8fd66-b7c1-4018-8dec-72bb51094025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d8fd66-b7c1-4018-8dec-72bb51094025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e68cec4-ea44-4b2a-a417-904dac280449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume 8761cbd0-b10e-47a5-969f-59fa384d5cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3', 'volume_size': 1} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146049852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8761cbd0-b10e-47a5-969f-59fa384d5cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:23Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Creating volume 8761cbd0-b10e-47a5-969f-59fa384d5cb3 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:23 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:23 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 1073741824 Sep 08 07:38:23 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (f9f943b9-79c3-4d82-b0c0-2bfde7b04a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3824dff7-9aec-451e-8d5b-824cd2b24dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3824dff7-9aec-451e-8d5b-824cd2b24dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091246007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fafda8d-86f7-4d92-80b9-644156afd4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:24Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ab3dac-c166-4c95-b19d-9c3f43f1d307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ab3dac-c166-4c95-b19d-9c3f43f1d307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7999e7ee-89c9-4532-8aa2-06c29ebdd537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7999e7ee-89c9-4532-8aa2-06c29ebdd537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fafda8d-86f7-4d92-80b9-644156afd4ac', 'volume_name': 'volume-3fafda8d-86f7-4d92-80b9-644156afd4ac', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d30bf3e-a268-452d-87b1-3b343a9100b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d30bf3e-a268-452d-87b1-3b343a9100b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9450604e-3c4f-43b2-be2f-1ea68078ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume 3fafda8d-86f7-4d92-80b9-644156afd4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fafda8d-86f7-4d92-80b9-644156afd4ac', 'volume_size': 1} Sep 08 07:38:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:24 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 1073741824" returned: 0 in 0.471s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:24 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 Sep 08 07:38:24 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (aebc5c80-1d53-4ef1-be92-f7d6073952d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e933ac1-e7d1-4291-9d9d-fcefd025ad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e933ac1-e7d1-4291-9d9d-fcefd025ad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693614559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4161b8b-7548-407f-8f5d-a4b52ce25ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:24Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51e1d90-8ea3-49b3-a78b-86832385681a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51e1d90-8ea3-49b3-a78b-86832385681a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f70160-d6d3-41e4-9021-61887a804826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f70160-d6d3-41e4-9021-61887a804826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4161b8b-7548-407f-8f5d-a4b52ce25ab9', 'volume_name': 'volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768a7296-fe7b-4057-8dfa-02dda63acf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768a7296-fe7b-4057-8dfa-02dda63acf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9997a6e8-eef9-4c11-bbe2-97d35abdf473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume b4161b8b-7548-407f-8f5d-a4b52ce25ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9', 'volume_size': 1} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:24 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3" returned: 0 in 0.273s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091246007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fafda8d-86f7-4d92-80b9-644156afd4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:24Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Creating volume 3fafda8d-86f7-4d92-80b9-644156afd4ac {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:24 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e68cec4-ea44-4b2a-a417-904dac280449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac 1073741824 Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d8a551-f802-443d-9ae4-b5ea745146af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:24 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 (8761cbd0-b10e-47a5-969f-59fa384d5cb3): created successfully Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d8a551-f802-443d-9ae4-b5ea745146af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (83901204-5339-4e9c-9d40-1e0199dc07ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:24 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3887035e-9263-4379-8234-c6936d4e25ed tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created volume successfully. Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (81d5cf5d-8969-441a-ad15-c32432c7edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c01959-693c-4784-9455-282c5e600021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c01959-693c-4784-9455-282c5e600021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1930072414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6abdf0e-14b0-4bc9-83e7-9b7fada84596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:25Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5072b965-5c1e-4624-95b9-f5cc42d77acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5072b965-5c1e-4624-95b9-f5cc42d77acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a77959d-4e2f-4411-b393-56930a1d6ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a77959d-4e2f-4411-b393-56930a1d6ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6abdf0e-14b0-4bc9-83e7-9b7fada84596', 'volume_name': 'volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ed5f8e-6612-4813-9f59-c15684f9fa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ed5f8e-6612-4813-9f59-c15684f9fa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984674b6-d23e-4a9a-8151-ecd9ebe95863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:24 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume d6abdf0e-14b0-4bc9-83e7-9b7fada84596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596', 'volume_size': 1} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:24 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac 1073741824" returned: 0 in 0.502s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:24 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac Sep 08 07:38:24 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (fc39eb0e-353f-413a-9517-266eb49788f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a87919d-0096-4ead-b8ab-cdaaa06a7f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a87919d-0096-4ead-b8ab-cdaaa06a7f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048703863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1a3edf-37bf-4476-bd93-9b7ef5277d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:25Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812c0c90-35f4-438a-86fc-6e735dcd4eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812c0c90-35f4-438a-86fc-6e735dcd4eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d548f857-20fa-4365-9c1a-92178d557104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d548f857-20fa-4365-9c1a-92178d557104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1a3edf-37bf-4476-bd93-9b7ef5277d0d', 'volume_name': 'volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107bd12f-3fc7-4ee3-ab69-54582d4efbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107bd12f-3fc7-4ee3-ab69-54582d4efbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236e7da7-f86d-4345-9bea-514ccebcddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:25 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume 5b1a3edf-37bf-4476-bd93-9b7ef5277d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d', 'volume_size': 1} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:25 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac" returned: 0 in 0.262s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693614559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4161b8b-7548-407f-8f5d-a4b52ce25ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:24Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Creating volume b4161b8b-7548-407f-8f5d-a4b52ce25ab9 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:25 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9450604e-3c4f-43b2-be2f-1ea68078ecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fafda8d-86f7-4d92-80b9-644156afd4ac', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55035cb0-aa3e-44be-ab2d-d042862eb018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:25 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 1073741824 Sep 08 07:38:25 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:25 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume volume-3fafda8d-86f7-4d92-80b9-644156afd4ac (3fafda8d-86f7-4d92-80b9-644156afd4ac): created successfully Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55035cb0-aa3e-44be-ab2d-d042862eb018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (f9f943b9-79c3-4d82-b0c0-2bfde7b04a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:25 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-de1097b0-a747-4e65-be14-aaa4c97a986f tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created volume successfully. Sep 08 07:38:25 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 1073741824" returned: 0 in 0.425s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:25 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 Sep 08 07:38:25 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:25 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9" returned: 0 in 0.248s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.204s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1930072414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6abdf0e-14b0-4bc9-83e7-9b7fada84596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:25Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Creating volume d6abdf0e-14b0-4bc9-83e7-9b7fada84596 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:25 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9997a6e8-eef9-4c11-bbe2-97d35abdf473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:25 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 1073741824 Sep 08 07:38:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b9fd13-ecc6-48ae-b010-87ff429afbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:25 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 (b4161b8b-7548-407f-8f5d-a4b52ce25ab9): created successfully Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b9fd13-ecc6-48ae-b010-87ff429afbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (aebc5c80-1d53-4ef1-be92-f7d6073952d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-620201b1-90cf-42d4-a44f-d7e688b1c620 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created volume successfully. Sep 08 07:38:26 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 1073741824" returned: 0 in 0.412s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:26 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 Sep 08 07:38:26 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:26 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596" returned: 0 in 0.244s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048703863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1a3edf-37bf-4476-bd93-9b7ef5277d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b23df1cdbb443fb6c87cda4fadf1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:25Z,use_quota=True,user_id='5010361a6462479f9da662ceb6f99623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Creating volume 5b1a3edf-37bf-4476-bd93-9b7ef5277d0d {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:26 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984674b6-d23e-4a9a-8151-ecd9ebe95863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:26 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d 1073741824 Sep 08 07:38:26 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441a6509-6ff4-4ab2-8f09-afd23ba43d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 (d6abdf0e-14b0-4bc9-83e7-9b7fada84596): created successfully Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441a6509-6ff4-4ab2-8f09-afd23ba43d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (81d5cf5d-8969-441a-ad15-c32432c7edfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b3720566-7899-4852-9985-f60038bcc0cf tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created volume successfully. Sep 08 07:38:27 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d 1073741824" returned: 0 in 0.418s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:27 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d Sep 08 07:38:27 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:27 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d" returned: 0 in 0.241s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:38:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236e7da7-f86d-4345-9bea-514ccebcddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc0616b-f5d0-4b84-8420-d9959a4d1e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Volume volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d (5b1a3edf-37bf-4476-bd93-9b7ef5277d0d): created successfully Sep 08 07:38:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc0616b-f5d0-4b84-8420-d9959a4d1e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Flow 'volume_create_manager' (fc39eb0e-353f-413a-9517-266eb49788f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-86e6f6e8-80e6-414c-b297-154eb2accb61 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created volume successfully. Sep 08 07:38:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-quobyte-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:28 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9ae931-f73c-4233-a414-66374e636885]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:28 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d Sep 08 07:38:28 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:28 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d" returned: 0 in 0.355s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:28 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d Sep 08 07:38:28 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:29 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d" returned: 0 in 0.242s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d" released by "delete_volume" :: held 0.636s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created reservations ['cd955afc-0981-4baa-89c3-b347f57be1f5', '5fd8be02-a63a-43d3-9089-8bf9ed4dd52f', 'c50ba21e-a86a-45af-8f97-687acd7846a3', '00b953d8-03ec-47b9-9d78-4d61ef02301c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:29 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:29 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:29 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.238s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:29 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Deleted volume successfully. Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8927cc36-2785-4324-970d-5550f3eff54a tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-5b1a3edf-37bf-4476-bd93-9b7ef5277d0d-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-d6abdf0e-14b0-4bc9-83e7-9b7fada84596-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-d6abdf0e-14b0-4bc9-83e7-9b7fada84596-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-quobyte-d6abdf0e-14b0-4bc9-83e7-9b7fada84596" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-d6abdf0e-14b0-4bc9-83e7-9b7fada84596" acquired by "delete_volume" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a325d00-9189-4e30-ba4b-ed4bb3524490]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:29 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 Sep 08 07:38:29 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:30 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596" returned: 0 in 0.341s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:30 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596 Sep 08 07:38:30 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:30 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d6abdf0e-14b0-4bc9-83e7-9b7fada84596" returned: 0 in 0.262s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-d6abdf0e-14b0-4bc9-83e7-9b7fada84596" released by "delete_volume" :: held 0.638s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created reservations ['2c0a69e9-0f46-473a-87ac-baf7f1f0bbca', 'fe3f1695-34a0-486f-bd9b-660c4f112a22', '98dbfd13-672a-4645-aaef-b980096a8c1e', 'a9f2ed10-4bf9-4f26-9e52-10cdcf9fe7ac'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:30 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:30 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:30 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:30 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Deleted volume successfully. Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0d1d3807-b65e-488e-a149-ef8a381ffe80 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-d6abdf0e-14b0-4bc9-83e7-9b7fada84596-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-b4161b8b-7548-407f-8f5d-a4b52ce25ab9-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-b4161b8b-7548-407f-8f5d-a4b52ce25ab9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-quobyte-b4161b8b-7548-407f-8f5d-a4b52ce25ab9" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-b4161b8b-7548-407f-8f5d-a4b52ce25ab9" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7f70ee-c9ca-4f9e-b822-980ee7c051e3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:30 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 Sep 08 07:38:30 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:31 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9" returned: 0 in 0.350s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:31 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9 Sep 08 07:38:31 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:31 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b4161b8b-7548-407f-8f5d-a4b52ce25ab9" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-b4161b8b-7548-407f-8f5d-a4b52ce25ab9" released by "delete_volume" :: held 0.634s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created reservations ['5c300952-7140-47b8-bd43-2ab76d3a1355', '4f74e1db-90a9-4f04-b3a6-b50d0c12bffa', 'd5bf7ef8-077b-4321-a896-a888f5d9ed8e', '35220ccd-a14d-4450-82b2-21dd5452ce54'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:31 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:31 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:31 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.245s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Deleted volume successfully. Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b9965daa-7db5-4303-b6e4-3ac176bcec92 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-b4161b8b-7548-407f-8f5d-a4b52ce25ab9-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-3fafda8d-86f7-4d92-80b9-644156afd4ac-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-3fafda8d-86f7-4d92-80b9-644156afd4ac-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-quobyte-3fafda8d-86f7-4d92-80b9-644156afd4ac" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-3fafda8d-86f7-4d92-80b9-644156afd4ac" acquired by "delete_volume" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcc912b-4829-418c-a201-8534774132a7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:32 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac Sep 08 07:38:32 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:32 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac" returned: 0 in 0.357s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:32 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac Sep 08 07:38:32 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:32 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3fafda8d-86f7-4d92-80b9-644156afd4ac" returned: 0 in 0.242s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-3fafda8d-86f7-4d92-80b9-644156afd4ac" released by "delete_volume" :: held 0.637s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created reservations ['b1c117e1-1481-4021-9ce9-d2b7af76fd4b', '46d5c0cd-c57a-4826-bda9-b6fe1b044f5b', '20dafe1f-83b0-4fcd-bb0e-e24ba436693c', 'cb75de5f-df24-43a7-a677-142cfc2eca13'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:32 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:32 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:32 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.247s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Deleted volume successfully. Sep 08 07:38:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-815d0348-208b-4fe2-97bb-a32489b92175 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-3fafda8d-86f7-4d92-80b9-644156afd4ac-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-8761cbd0-b10e-47a5-969f-59fa384d5cb3-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-8761cbd0-b10e-47a5-969f-59fa384d5cb3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-quobyte-8761cbd0-b10e-47a5-969f-59fa384d5cb3" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-8761cbd0-b10e-47a5-969f-59fa384d5cb3" acquired by "delete_volume" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[65149c40-5333-49b7-9c6b-f9c1afe5eaff]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:33 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 Sep 08 07:38:33 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:33 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3" returned: 0 in 0.353s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:33 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3 Sep 08 07:38:33 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:33 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-8761cbd0-b10e-47a5-969f-59fa384d5cb3" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-8761cbd0-b10e-47a5-969f-59fa384d5cb3" released by "delete_volume" :: held 0.636s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created reservations ['7befdf3d-8fa4-4341-a2e9-9e7546796ab1', '9bfb4128-7146-447e-bb06-579d23ed3064', '54d25442-6861-4e56-9204-e9edcdf47c1e', 'c7371c80-af01-4140-a73a-38395da6456d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:33 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:33 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:34 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.252s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:34 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Deleted volume successfully. Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-56bab93f-5834-41ad-acae-78cc5eca18e7 tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-8761cbd0-b10e-47a5-969f-59fa384d5cb3-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-9e8a6408-066d-4020-9e4c-97f562e086a6-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-9e8a6408-066d-4020-9e4c-97f562e086a6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "cinder-quobyte-9e8a6408-066d-4020-9e4c-97f562e086a6" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-9e8a6408-066d-4020-9e4c-97f562e086a6" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b563515-6d4e-4b8f-89e4-f1235058d955]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:34 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6 Sep 08 07:38:34 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:34 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6" returned: 0 in 0.352s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:34 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6 Sep 08 07:38:34 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:34 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9e8a6408-066d-4020-9e4c-97f562e086a6" returned: 0 in 0.242s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-quobyte-9e8a6408-066d-4020-9e4c-97f562e086a6" released by "delete_volume" :: held 0.631s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Created reservations ['fd9d65bf-14ee-41be-8e2a-d4e2414f2398', 'bd56e732-acf4-4d47-be27-b106229aaf7d', 'd117dd52-6bb9-42e6-a981-a4a5dc3de4e3', '9f07c850-3391-407e-9589-101186b20cc4'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:35 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:35 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:35 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.241s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:35 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Deleted volume successfully. Sep 08 07:38:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a8e5249f-79e3-47fc-bff4-e4b373a1097d tempest-CreateVolumesFromSourceVolumeTest-1465218735 None] Lock "cinder-9e8a6408-066d-4020-9e4c-97f562e086a6-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:37 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Flow 'volume_create_manager' (30faa211-285c-48d0-9c4f-7c7ec139a47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51397e3b-f5b1-4495-9499-24745f1717a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51397e3b-f5b1-4495-9499-24745f1717a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1383978175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626b0862-493f-452a-98fc-9cd8d283a7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93837e4dd8a498db06007b7cc3d5479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:38Z,use_quota=True,user_id='dfbab58ba79548a9b1e75e3e6a175d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4279095b-a0ba-4807-8ffd-9793cf7f94ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4279095b-a0ba-4807-8ffd-9793cf7f94ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e38c16e-7e4c-4e6b-be9a-94115db236ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e38c16e-7e4c-4e6b-be9a-94115db236ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626b0862-493f-452a-98fc-9cd8d283a7b2', 'volume_name': 'volume-626b0862-493f-452a-98fc-9cd8d283a7b2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6e166d-c087-4182-a057-29464b59c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6e166d-c087-4182-a057-29464b59c69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865e6dab-249c-4b66-8064-cc338e6bab6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:38 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Volume 626b0862-493f-452a-98fc-9cd8d283a7b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626b0862-493f-452a-98fc-9cd8d283a7b2', 'volume_size': 1} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1383978175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626b0862-493f-452a-98fc-9cd8d283a7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93837e4dd8a498db06007b7cc3d5479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:38Z,use_quota=True,user_id='dfbab58ba79548a9b1e75e3e6a175d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Creating volume 626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:38 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:38 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 1073741824 Sep 08 07:38:38 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:38 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 1073741824" returned: 0 in 0.394s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:38 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 Sep 08 07:38:38 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:38 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2" returned: 0 in 0.251s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865e6dab-249c-4b66-8064-cc338e6bab6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626b0862-493f-452a-98fc-9cd8d283a7b2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6397bf57-1b18-4956-8edb-45dec81efa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:38 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Volume volume-626b0862-493f-452a-98fc-9cd8d283a7b2 (626b0862-493f-452a-98fc-9cd8d283a7b2): created successfully Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6397bf57-1b18-4956-8edb-45dec81efa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Flow 'volume_create_manager' (30faa211-285c-48d0-9c4f-7c7ec139a47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-28d5e6ae-8739-4214-a6ae-beccaf754fcd tempest-VolumeDependencyTests-281960215 None] Created volume successfully. Sep 08 07:38:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Creating offline snapshot cb0062ab-b1f8-46c0-9d54-b5d3fd051290 of volume 626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:38:39 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a730cb45-aa09-4897-8719-c5b5eac11f17]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:39 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 Sep 08 07:38:39 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:39 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2" returned: 0 in 0.353s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:39 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 1G Sep 08 07:38:39 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:39 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 1G" returned: 0 in 0.378s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-626b0862-493f-452a-98fc-9cd8d283a7b2 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:39 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-626b0862-493f-452a-98fc-9cd8d283a7b2 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 Sep 08 07:38:39 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:40 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-626b0862-493f-452a-98fc-9cd8d283a7b2 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290" returned: 0 in 0.281s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:40 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 is being set with open permissions: ugo+rw Sep 08 07:38:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:40 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 Sep 08 07:38:40 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:40 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290" returned: 0 in 0.239s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:40 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.info Sep 08 07:38:40 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:40 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.info" returned: 0 in 0.248s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:40 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.info is being set with open permissions: ugo+rw Sep 08 07:38:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:40 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.info Sep 08 07:38:40 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:40 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.info" returned: 0 in 0.239s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bae71215-af1e-4e58-8689-4a69a874abd3 tempest-VolumeDependencyTests-281960215 None] Create snapshot completed successfully Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Flow 'volume_create_manager' (9af623be-aa79-4a79-bfb0-b39a4b426118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dff6c9-faeb-4518-afd7-a096e9d423ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dff6c9-faeb-4518-afd7-a096e9d423ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2016648737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82f6fe1-9a06-485b-ad67-fcce680a98d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93837e4dd8a498db06007b7cc3d5479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb0062ab-b1f8-46c0-9d54-b5d3fd051290,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:42Z,use_quota=True,user_id='dfbab58ba79548a9b1e75e3e6a175d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdca164b-11a8-4729-afd8-049a8470b6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdca164b-11a8-4729-afd8-049a8470b6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220b04a9-113e-4d84-b5f4-68361443a9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220b04a9-113e-4d84-b5f4-68361443a9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b82f6fe1-9a06-485b-ad67-fcce680a98d1', 'volume_name': 'volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1', 'volume_size': 1, 'snapshot_id': 'cb0062ab-b1f8-46c0-9d54-b5d3fd051290'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcb3c79-ebba-4dbe-9fe6-0b6d654547f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcb3c79-ebba-4dbe-9fe6-0b6d654547f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4916fb69-8e57-4cac-99c1-ac2c8144e3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:41 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Volume b82f6fe1-9a06-485b-ad67-fcce680a98d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1', 'volume_size': 1, 'snapshot_id': 'cb0062ab-b1f8-46c0-9d54-b5d3fd051290'} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Acquiring lock "cinder-quobyte-cb0062ab-b1f8-46c0-9d54-b5d3fd051290-b82f6fe1-9a06-485b-ad67-fcce680a98d1" by "_create_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-cb0062ab-b1f8-46c0-9d54-b5d3fd051290-b82f6fe1-9a06-485b-ad67-fcce680a98d1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Creating volume b82f6fe1-9a06-485b-ad67-fcce680a98d1 from snapshot cb0062ab-b1f8-46c0-9d54-b5d3fd051290 {{(pid=87278) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Acquiring lock "cinder-quobyte-b82f6fe1-9a06-485b-ad67-fcce680a98d1" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-b82f6fe1-9a06-485b-ad67-fcce680a98d1" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] snapshot: cb0062ab-b1f8-46c0-9d54-b5d3fd051290, volume: b82f6fe1-9a06-485b-ad67-fcce680a98d1, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[146e76e8-7b3b-4fd5-a3cf-ebb910434e81]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:41 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 Sep 08 07:38:41 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:42 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290" returned: 0 in 0.359s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-626b0862-493f-452a-98fc-9cd8d283a7b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:38:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e60cb56-d08e-46d2-87ce-84f826dfdc1f]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:42 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 Sep 08 07:38:42 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:42 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2" returned: 0 in 0.355s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:38:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:38:42 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:38:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:42 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 Sep 08 07:38:42 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:38:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:44 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:44 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:45 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.475s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:38:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:38:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:38:46 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1" returned: 0 in 4.140s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:46 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:38:46 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Converted 1024.00 MB image at 247.26 MB/s Sep 08 07:38:46 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 is being set with open permissions: ugo+rw Sep 08 07:38:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:46 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 Sep 08 07:38:46 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:46 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1" returned: 0 in 0.234s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-b82f6fe1-9a06-485b-ad67-fcce680a98d1" released by "_copy_volume_from_snapshot" :: held 5.163s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-cb0062ab-b1f8-46c0-9d54-b5d3fd051290-b82f6fe1-9a06-485b-ad67-fcce680a98d1" released by "_create_volume_from_snapshot" :: held 5.220s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.236s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4916fb69-8e57-4cac-99c1-ac2c8144e3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1', 'volume_size': 1, 'snapshot_id': 'cb0062ab-b1f8-46c0-9d54-b5d3fd051290'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c5e811-7e94-4a29-831d-5c18a59b3175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:47 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Volume volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 (b82f6fe1-9a06-485b-ad67-fcce680a98d1): created successfully Sep 08 07:38:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c5e811-7e94-4a29-831d-5c18a59b3175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Flow 'volume_create_manager' (9af623be-aa79-4a79-bfb0-b39a4b426118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a03833fc-2c64-4586-9739-27ff1e7781de tempest-VolumeDependencyTests-281960215 None] Created volume successfully. Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Acquiring lock "cinder-cb0062ab-b1f8-46c0-9d54-b5d3fd051290-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Lock "cinder-cb0062ab-b1f8-46c0-9d54-b5d3fd051290-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Acquiring lock "cinder-quobyte-626b0862-493f-452a-98fc-9cd8d283a7b2" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-626b0862-493f-452a-98fc-9cd8d283a7b2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Acquiring lock "cinder-quobyte-cb0062ab-b1f8-46c0-9d54-b5d3fd051290" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-cb0062ab-b1f8-46c0-9d54-b5d3fd051290" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Deleting offline snapshot cb0062ab-b1f8-46c0-9d54-b5d3fd051290 of volume 626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] snapshot_file for this snap is: volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bdb018-c99d-44d1-8332-66fd4eebad2d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:48 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 Sep 08 07:38:48 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:48 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290" returned: 0 in 0.362s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-626b0862-493f-452a-98fc-9cd8d283a7b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f0ab98-be66-4f40-b5f7-b8acabfd956e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:48 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 Sep 08 07:38:48 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:49 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2" returned: 0 in 0.527s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:49 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 Sep 08 07:38:49 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:49 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290" returned: 0 in 0.323s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:49 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290 Sep 08 07:38:49 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:49 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2.cb0062ab-b1f8-46c0-9d54-b5d3fd051290" returned: 0 in 0.241s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-cb0062ab-b1f8-46c0-9d54-b5d3fd051290" released by "_delete_snapshot" :: held 1.544s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-626b0862-493f-452a-98fc-9cd8d283a7b2" released by "delete_snapshot" :: held 1.566s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:49 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Created reservations ['05438115-5fb9-443f-be9f-3a279c4353a3', '3616e2ea-b956-4875-bca8-13399bb9e383', 'f39c0605-0cc1-47d8-9d74-0031651d9c7b', '83594740-02e1-4f2d-840a-d89a29f083b3'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:49 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Delete snapshot completed successfully. Sep 08 07:38:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a271e637-824b-4786-8436-1c442b8f7adb tempest-VolumeDependencyTests-281960215 None] Lock "cinder-cb0062ab-b1f8-46c0-9d54-b5d3fd051290-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Acquiring lock "cinder-626b0862-493f-452a-98fc-9cd8d283a7b2-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Lock "cinder-626b0862-493f-452a-98fc-9cd8d283a7b2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Acquiring lock "cinder-quobyte-626b0862-493f-452a-98fc-9cd8d283a7b2" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-626b0862-493f-452a-98fc-9cd8d283a7b2" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:50 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e83a67f-0bd4-4055-8f2c-3bf4b741e222]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:50 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 Sep 08 07:38:50 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:50 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2" returned: 0 in 0.358s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:50 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2 Sep 08 07:38:50 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:51 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-626b0862-493f-452a-98fc-9cd8d283a7b2" returned: 0 in 0.238s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-626b0862-493f-452a-98fc-9cd8d283a7b2" released by "delete_volume" :: held 0.649s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Created reservations ['30739b1a-8788-4b83-b4d8-8189b58ee8e9', '20f1e681-c0f6-4410-b1eb-cd1c3582ed1c', 'cb0417ac-9fa7-4d34-b417-c7978bdb290e', 'ac33aa58-9e09-44dc-824c-72b14f73900c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:51 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:51 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:51 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:51 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Deleted volume successfully. Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a12b8dde-d4bf-4dc8-b94f-3e7f0f890bde tempest-VolumeDependencyTests-281960215 None] Lock "cinder-626b0862-493f-452a-98fc-9cd8d283a7b2-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Acquiring lock "cinder-b82f6fe1-9a06-485b-ad67-fcce680a98d1-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Lock "cinder-b82f6fe1-9a06-485b-ad67-fcce680a98d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Acquiring lock "cinder-quobyte-b82f6fe1-9a06-485b-ad67-fcce680a98d1" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-b82f6fe1-9a06-485b-ad67-fcce680a98d1" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afff453-d24a-4fa6-9fc8-b042f02c1b23]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:51 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 Sep 08 07:38:51 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:51 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1" returned: 0 in 0.349s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:51 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1 Sep 08 07:38:51 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:52 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b82f6fe1-9a06-485b-ad67-fcce680a98d1" returned: 0 in 0.239s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Lock "cinder-quobyte-b82f6fe1-9a06-485b-ad67-fcce680a98d1" released by "delete_volume" :: held 0.625s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Created reservations ['93326a13-24f9-4123-afa9-ad65b696c6c6', '34d8c1b6-78fa-49dd-8ae9-dfaea96f9c64', '487da494-1033-44d5-b47a-e90223bc0684', '28b05af8-d544-4a9d-b97a-86f7fb12f33d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:52 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:52 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:52 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.235s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:52 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Deleted volume successfully. Sep 08 07:38:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7070c175-6c9e-456b-a392-8d7b92eb7ad4 tempest-VolumeDependencyTests-281960215 None] Lock "cinder-b82f6fe1-9a06-485b-ad67-fcce680a98d1-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Flow 'volume_create_manager' (3827a4c7-e97a-49bc-89a9-5cf81e285de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8096a1de-6f27-441f-8250-9f6957c4d2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8096a1de-6f27-441f-8250-9f6957c4d2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1406955602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc85ff6-532a-4508-aaed-e07dca125a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5064b8a15ac949418175a934fb1ce17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:56Z,use_quota=True,user_id='9e67b22a7ca445bca986104011c3e2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5e723e-4b07-4f39-917b-84a0234d7336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5e723e-4b07-4f39-917b-84a0234d7336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474cbbcd-b228-4d55-b261-d873c838f1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474cbbcd-b228-4d55-b261-d873c838f1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dc85ff6-532a-4508-aaed-e07dca125a60', 'volume_name': 'volume-7dc85ff6-532a-4508-aaed-e07dca125a60', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92630efe-4434-4493-9f0f-20a5ec5af675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92630efe-4434-4493-9f0f-20a5ec5af675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654950e3-7317-4383-a253-010a68133b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:55 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Volume 7dc85ff6-532a-4508-aaed-e07dca125a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dc85ff6-532a-4508-aaed-e07dca125a60', 'volume_size': 1} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1406955602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc85ff6-532a-4508-aaed-e07dca125a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5064b8a15ac949418175a934fb1ce17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:56Z,use_quota=True,user_id='9e67b22a7ca445bca986104011c3e2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Creating volume 7dc85ff6-532a-4508-aaed-e07dca125a60 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:55 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:38:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:56 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60 1073741824 Sep 08 07:38:56 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:56 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60 1073741824" returned: 0 in 0.402s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:56 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60 Sep 08 07:38:56 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:56 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60" returned: 0 in 0.257s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:38:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654950e3-7317-4383-a253-010a68133b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc85ff6-532a-4508-aaed-e07dca125a60', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1bd92d-6167-4153-b4e7-247e2de5c21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:56 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Volume volume-7dc85ff6-532a-4508-aaed-e07dca125a60 (7dc85ff6-532a-4508-aaed-e07dca125a60): created successfully Sep 08 07:38:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1bd92d-6167-4153-b4e7-247e2de5c21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Flow 'volume_create_manager' (3827a4c7-e97a-49bc-89a9-5cf81e285de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a1f2bdb7-7f63-4323-9998-c0d4a463ef4e tempest-ProjectReaderTests-1954746116 None] Created volume successfully. Sep 08 07:38:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Acquiring lock "cinder-7dc85ff6-532a-4508-aaed-e07dca125a60-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Lock "cinder-7dc85ff6-532a-4508-aaed-e07dca125a60-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Acquiring lock "cinder-quobyte-7dc85ff6-532a-4508-aaed-e07dca125a60" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Lock "cinder-quobyte-7dc85ff6-532a-4508-aaed-e07dca125a60" acquired by "delete_volume" :: waited 0.013s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:38:57 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e67114-abd7-4180-8ce1-2dd709798f0c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:38:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:57 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60 Sep 08 07:38:57 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:57 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60" returned: 0 in 0.358s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:57 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60 Sep 08 07:38:57 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:58 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7dc85ff6-532a-4508-aaed-e07dca125a60" returned: 0 in 0.245s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Lock "cinder-quobyte-7dc85ff6-532a-4508-aaed-e07dca125a60" released by "delete_volume" :: held 0.641s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Created reservations ['62b1a3a4-b56e-4ad4-8a58-c0ac6485f36b', '6be4e521-f18b-4fa2-a74b-444006f471e8', 'e09c4030-211b-4cb4-9791-892bba275b93', '8bf49a6e-00f7-4c57-8c6d-0c38c083ff53'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:58 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:38:58 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:58 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.242s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:38:58 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Deleted volume successfully. Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-622f2a05-77ab-4169-ad83-cd73c7a247f0 tempest-ProjectReaderTests-1954746116 None] Lock "cinder-7dc85ff6-532a-4508-aaed-e07dca125a60-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Flow 'volume_create_manager' (a3fa5e13-742b-4efd-ae47-20000d87d007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc80313a-ed76-49a0-b72d-5e037b386ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc80313a-ed76-49a0-b72d-5e037b386ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975036878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a288b7-f073-449c-8711-c51c7d8f0daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5064b8a15ac949418175a934fb1ce17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:59Z,use_quota=True,user_id='9e67b22a7ca445bca986104011c3e2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4fada5-508a-4bd6-82ca-cf1dc60aae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4fada5-508a-4bd6-82ca-cf1dc60aae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb1eb0d-f808-4b2a-b9e5-b4dde8d92363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb1eb0d-f808-4b2a-b9e5-b4dde8d92363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a288b7-f073-449c-8711-c51c7d8f0daf', 'volume_name': 'volume-e8a288b7-f073-449c-8711-c51c7d8f0daf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aceca2fd-b79f-4270-9e5c-d8ee38b62cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aceca2fd-b79f-4270-9e5c-d8ee38b62cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ffbf2e-b625-4d24-a53b-29570c426640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:58 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Volume e8a288b7-f073-449c-8711-c51c7d8f0daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a288b7-f073-449c-8711-c51c7d8f0daf', 'volume_size': 1} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975036878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a288b7-f073-449c-8711-c51c7d8f0daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5064b8a15ac949418175a934fb1ce17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:38:59Z,use_quota=True,user_id='9e67b22a7ca445bca986104011c3e2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Creating volume e8a288b7-f073-449c-8711-c51c7d8f0daf {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:38:58 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:38:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:59 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf 1073741824 Sep 08 07:38:59 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:59 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf 1073741824" returned: 0 in 0.400s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:38:59 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf Sep 08 07:38:59 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:38:59 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ffbf2e-b625-4d24-a53b-29570c426640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a288b7-f073-449c-8711-c51c7d8f0daf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21daa666-d935-4508-a0eb-71e0912f4706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:38:59 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Volume volume-e8a288b7-f073-449c-8711-c51c7d8f0daf (e8a288b7-f073-449c-8711-c51c7d8f0daf): created successfully Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21daa666-d935-4508-a0eb-71e0912f4706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Flow 'volume_create_manager' (a3fa5e13-742b-4efd-ae47-20000d87d007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:38:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-893e8b40-0061-4a09-91af-ba0a545b1066 tempest-ProjectReaderTests-1954746116 None] Created volume successfully. Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Acquiring lock "cinder-e8a288b7-f073-449c-8711-c51c7d8f0daf-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:38:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Lock "cinder-e8a288b7-f073-449c-8711-c51c7d8f0daf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Acquiring lock "cinder-quobyte-e8a288b7-f073-449c-8711-c51c7d8f0daf" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Lock "cinder-quobyte-e8a288b7-f073-449c-8711-c51c7d8f0daf" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3486b4f-36c6-4599-83d4-7a6a537f5444]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:00 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf Sep 08 07:39:00 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:00 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf" returned: 0 in 0.349s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:00 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf Sep 08 07:39:00 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:00 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8a288b7-f073-449c-8711-c51c7d8f0daf" returned: 0 in 0.249s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Lock "cinder-quobyte-e8a288b7-f073-449c-8711-c51c7d8f0daf" released by "delete_volume" :: held 0.633s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Created reservations ['28e01ec6-1bb9-4f00-9715-68ce0b463285', '1ecb8d39-07fe-42fe-b40b-7ddb59d1db54', '4488454f-1b15-4043-a58e-cc6d56b696c0', '4ade1c37-b4dc-4b2f-87a0-01b6d2ad44ca'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:00 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:00 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:01 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.243s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:01 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Deleted volume successfully. Sep 08 07:39:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-45e6ebab-de1e-4249-948c-a9bdc2847513 tempest-ProjectReaderTests-1954746116 None] Lock "cinder-e8a288b7-f073-449c-8711-c51c7d8f0daf-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:10 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=75,cinder:INSERT=31,cinder:UPDATE=119,cinder:DELETE=9 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:39:11 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=115,cinder:SELECT=86,cinder:INSERT=24,cinder:DELETE=12 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (7922a444-5f62-4317-a2e1-0c79d464af52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29abf631-3ce3-4634-be4d-aac6387527a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29abf631-3ce3-4634-be4d-aac6387527a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571463222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fba9f54-ef95-4a93-b890-00acac59b81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:13Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfa8eb7-e444-4990-ade0-8fcaad8fe231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfa8eb7-e444-4990-ade0-8fcaad8fe231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51465ff-71c4-4e23-930c-9a2045007f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51465ff-71c4-4e23-930c-9a2045007f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fba9f54-ef95-4a93-b890-00acac59b81d', 'volume_name': 'volume-7fba9f54-ef95-4a93-b890-00acac59b81d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529bb2b5-9b02-4bb8-b563-077015a1f209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529bb2b5-9b02-4bb8-b563-077015a1f209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f8bfd0-41cb-4190-9363-90a909ff5bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume 7fba9f54-ef95-4a93-b890-00acac59b81d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fba9f54-ef95-4a93-b890-00acac59b81d', 'volume_size': 1} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571463222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fba9f54-ef95-4a93-b890-00acac59b81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:13Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Creating volume 7fba9f54-ef95-4a93-b890-00acac59b81d {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:13 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:13 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d 1073741824 Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:13 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (4340c14d-511b-4e9e-8417-924b53b25851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998ba5dc-c173-41b6-95a6-a87605370e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998ba5dc-c173-41b6-95a6-a87605370e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670299427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d726ed3-c826-4585-98dd-d57264e4ae5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:13Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4fc4ca-6e2e-468d-80b0-f2ae221f17ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4fc4ca-6e2e-468d-80b0-f2ae221f17ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c466e9e9-4cef-46ec-a201-74d1a57a9c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c466e9e9-4cef-46ec-a201-74d1a57a9c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d726ed3-c826-4585-98dd-d57264e4ae5a', 'volume_name': 'volume-4d726ed3-c826-4585-98dd-d57264e4ae5a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f016933-1629-4c01-9bab-c148c2c41cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f016933-1629-4c01-9bab-c148c2c41cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5df246d-8a7e-40d1-97ff-51a0c06b64f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Volume 4d726ed3-c826-4585-98dd-d57264e4ae5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d726ed3-c826-4585-98dd-d57264e4ae5a', 'volume_size': 1} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (27388b22-46bf-4533-a720-6d2d7b575732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9488b18a-8646-4a85-acf6-ad27fef61f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9488b18a-8646-4a85-acf6-ad27fef61f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-581566156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62e8e00-40c9-418d-a021-c241d542c8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:14Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5691289f-19c8-4276-ac5a-99f21561d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5691289f-19c8-4276-ac5a-99f21561d547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac767df-481e-433a-a8b2-eb7335b592c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac767df-481e-433a-a8b2-eb7335b592c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62e8e00-40c9-418d-a021-c241d542c8bc', 'volume_name': 'volume-b62e8e00-40c9-418d-a021-c241d542c8bc', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2c2853-5a4a-4fbc-a784-e80b49b18931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2c2853-5a4a-4fbc-a784-e80b49b18931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b7b8d0-6789-4d60-872a-6ed7ee54c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:13 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Volume b62e8e00-40c9-418d-a021-c241d542c8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62e8e00-40c9-418d-a021-c241d542c8bc', 'volume_size': 1} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:13 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d 1073741824" returned: 0 in 0.652s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:14 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d Sep 08 07:39:14 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Flow 'volume_create_manager' (5e6af15b-d73d-49bd-aec0-2f28b2c6a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55071aa-5f6a-45e2-9e82-31a138307716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55071aa-5f6a-45e2-9e82-31a138307716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc709d9f-6985-4f67-87f9-8787fcf96ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c0aa0d086e4588885b4681e8f25c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:14Z,use_quota=True,user_id='a402b9a76cb349b3801e9d35832a9ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f536eb5a-5a62-4b28-a187-a65678bb7fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f536eb5a-5a62-4b28-a187-a65678bb7fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7660f09-4ef5-4424-8c6e-f9e9ac965ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7660f09-4ef5-4424-8c6e-f9e9ac965ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc709d9f-6985-4f67-87f9-8787fcf96ca0', 'volume_name': 'volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ca1d8a-dd85-4dbc-950b-446aaff54fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ca1d8a-dd85-4dbc-950b-446aaff54fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3159cc04-f3de-4449-8fb4-a2e4f24f5d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Volume bc709d9f-6985-4f67-87f9-8787fcf96ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0', 'volume_size': 1} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (128d209b-b7f2-4102-8664-eb9babb3bf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba533d6-35fc-4eef-bedd-8a38bf06403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d" returned: 0 in 0.371s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670299427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d726ed3-c826-4585-98dd-d57264e4ae5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:13Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Creating volume 4d726ed3-c826-4585-98dd-d57264e4ae5a {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:14 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba533d6-35fc-4eef-bedd-8a38bf06403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225331467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ec7dcc-73e8-443f-a270-0a71d9e0701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:14Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1e4a0f-2c25-4cc6-9c44-61a08f3ed3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1e4a0f-2c25-4cc6-9c44-61a08f3ed3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387cfd9d-6406-4370-b92d-9b382315c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387cfd9d-6406-4370-b92d-9b382315c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ec7dcc-73e8-443f-a270-0a71d9e0701d', 'volume_name': 'volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a 1073741824 Sep 08 07:39:14 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4cd3e4-1022-4952-a139-4bb1d7e4844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4cd3e4-1022-4952-a139-4bb1d7e4844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18366d84-15ff-4eff-a2a3-2549cef48338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Volume 99ec7dcc-73e8-443f-a270-0a71d9e0701d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d', 'volume_size': 1} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f8bfd0-41cb-4190-9363-90a909ff5bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fba9f54-ef95-4a93-b890-00acac59b81d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b078a1-45f0-4dec-ada8-ee5689dddb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume volume-7fba9f54-ef95-4a93-b890-00acac59b81d (7fba9f54-ef95-4a93-b890-00acac59b81d): created successfully Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b078a1-45f0-4dec-ada8-ee5689dddb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (7922a444-5f62-4317-a2e1-0c79d464af52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-881c28f3-7c2b-4611-8add-4535595029e0 tempest-CreateVolumesFromSnapshotTest-523906847 None] Created volume successfully. Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (f6d69162-4be7-4889-ba04-e00eae0b3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f2cd60-c3e0-4db4-9c4f-70c7961e8c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f2cd60-c3e0-4db4-9c4f-70c7961e8c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829552118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2053210f-4a89-43d8-910d-391872b225f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:15Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0df4ab-afd2-4e64-85c7-3f69a66997f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0df4ab-afd2-4e64-85c7-3f69a66997f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231f5806-0377-46dd-9e86-8a428bd52086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231f5806-0377-46dd-9e86-8a428bd52086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2053210f-4a89-43d8-910d-391872b225f5', 'volume_name': 'volume-2053210f-4a89-43d8-910d-391872b225f5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e814f1a3-113b-4a8d-919e-06d2f02beb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e814f1a3-113b-4a8d-919e-06d2f02beb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a60089-5830-4fd6-90d8-04e041a5c842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Volume 2053210f-4a89-43d8-910d-391872b225f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2053210f-4a89-43d8-910d-391872b225f5', 'volume_size': 1} Sep 08 07:39:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:14 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a 1073741824" returned: 0 in 0.618s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:15 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a Sep 08 07:39:15 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (9d7336bb-3eec-4120-b7fa-3f525241c874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412cfb05-d50c-45ef-9e57-8cd7a5e49a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412cfb05-d50c-45ef-9e57-8cd7a5e49a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233045793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174d8cfa-4f55-462b-8fea-205527686bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:15Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db87f536-1c41-4d65-ad78-f415ea950149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db87f536-1c41-4d65-ad78-f415ea950149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ab21dd-a372-4a9e-88a1-e230324120fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ab21dd-a372-4a9e-88a1-e230324120fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '174d8cfa-4f55-462b-8fea-205527686bec', 'volume_name': 'volume-174d8cfa-4f55-462b-8fea-205527686bec', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beb69c5-14c5-4071-8799-aab906fe9a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beb69c5-14c5-4071-8799-aab906fe9a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2066dac-b0b5-4e58-ad5e-dd720f6f0e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:15 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Volume 174d8cfa-4f55-462b-8fea-205527686bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-174d8cfa-4f55-462b-8fea-205527686bec', 'volume_size': 1} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:15 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a" returned: 0 in 0.311s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-581566156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62e8e00-40c9-418d-a021-c241d542c8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:14Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Creating volume b62e8e00-40c9-418d-a021-c241d542c8bc {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:15 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:15 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc 1073741824 Sep 08 07:39:15 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5df246d-8a7e-40d1-97ff-51a0c06b64f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d726ed3-c826-4585-98dd-d57264e4ae5a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabde472-d1be-4805-a1e3-d5302d426a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:15 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Volume volume-4d726ed3-c826-4585-98dd-d57264e4ae5a (4d726ed3-c826-4585-98dd-d57264e4ae5a): created successfully Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabde472-d1be-4805-a1e3-d5302d426a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (4340c14d-511b-4e9e-8417-924b53b25851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:15 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-24c78cf2-1a54-4704-9fce-f972269d880c tempest-CreateVolumesFromImageTest-855382389 None] Created volume successfully. Sep 08 07:39:15 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc 1073741824" returned: 0 in 0.433s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:15 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc Sep 08 07:39:15 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:16 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc" returned: 0 in 0.249s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.781s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc709d9f-6985-4f67-87f9-8787fcf96ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c0aa0d086e4588885b4681e8f25c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:14Z,use_quota=True,user_id='a402b9a76cb349b3801e9d35832a9ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Creating volume bc709d9f-6985-4f67-87f9-8787fcf96ca0 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:16 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b7b8d0-6789-4d60-872a-6ed7ee54c611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62e8e00-40c9-418d-a021-c241d542c8bc', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:16 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 1073741824 Sep 08 07:39:16 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f6937b-45d6-454e-917a-a35a5ca19ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Volume volume-b62e8e00-40c9-418d-a021-c241d542c8bc (b62e8e00-40c9-418d-a021-c241d542c8bc): created successfully Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f6937b-45d6-454e-917a-a35a5ca19ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (27388b22-46bf-4533-a720-6d2d7b575732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:16 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5ac6b606-2626-4634-bde5-954ed8c156e2 tempest-CreateVolumesFromImageTest-855382389 None] Created volume successfully. Sep 08 07:39:16 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 1073741824" returned: 0 in 0.452s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:16 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 Sep 08 07:39:16 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:16 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.403s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225331467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ec7dcc-73e8-443f-a270-0a71d9e0701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:14Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Creating volume 99ec7dcc-73e8-443f-a270-0a71d9e0701d {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:16 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3159cc04-f3de-4449-8fb4-a2e4f24f5d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:16 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d 1073741824 Sep 08 07:39:16 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbb0428-bc97-4370-aba6-9edf453204b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:16 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Volume volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 (bc709d9f-6985-4f67-87f9-8787fcf96ca0): created successfully Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbb0428-bc97-4370-aba6-9edf453204b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:16 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Flow 'volume_create_manager' (5e6af15b-d73d-49bd-aec0-2f28b2c6a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:16 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ca7cf9e5-7197-45f0-9654-756308ad2916 tempest-CinderUnicodeTest-1491057004 None] Created volume successfully. Sep 08 07:39:17 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d 1073741824" returned: 0 in 0.534s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:17 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d Sep 08 07:39:17 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Flow 'volume_create_manager' (1188740c-5fbe-4e58-be28-a7699721bc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307a74f2-e4ab-4e14-846e-fff0c113c00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307a74f2-e4ab-4e14-846e-fff0c113c00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7f5149-23b7-42d6-a2a9-4c931668b53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af615657640e4c9c9adf53740cb358b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:18Z,use_quota=True,user_id='a1a20105ad014b34baeed582d43d1aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27f9e561-cc87-40b1-95dc-bdf4836863eb),volume_type_id=27f9e561-cc87-40b1-95dc-bdf4836863eb)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528ec22a-1f74-483d-923e-702daefd34f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528ec22a-1f74-483d-923e-702daefd34f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9045c88-d06f-4de7-80eb-492fb84a137c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:39:17 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d" returned: 0 in 0.296s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.952s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829552118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2053210f-4a89-43d8-910d-391872b225f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:15Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Creating volume 2053210f-4a89-43d8-910d-391872b225f5 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:17 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:17 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5 1073741824 Sep 08 07:39:17 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18366d84-15ff-4eff-a2a3-2549cef48338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4715b739-ca62-40f0-92b8-f9bcf068dd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Volume volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d (99ec7dcc-73e8-443f-a270-0a71d9e0701d): created successfully Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4715b739-ca62-40f0-92b8-f9bcf068dd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (128d209b-b7f2-4102-8664-eb9babb3bf4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-71a3b38e-0ffc-419b-aac6-feed4da21071 tempest-CreateVolumesFromImageTest-855382389 None] Created volume successfully. Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Flow 'volume_create_manager' (f8402fd9-445d-4c05-a766-c7b251431878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44edde9c-72b2-4a6d-8e18-eab044d5fbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44edde9c-72b2-4a6d-8e18-eab044d5fbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-708024273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae51fb6-4106-4610-92ba-deb10d6021f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c0aa0d086e4588885b4681e8f25c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:18Z,use_quota=True,user_id='a402b9a76cb349b3801e9d35832a9ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687d7b45-d7ca-4b89-a0d9-514efab3e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687d7b45-d7ca-4b89-a0d9-514efab3e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4118d23-ba22-41c2-a400-1d3963153ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4118d23-ba22-41c2-a400-1d3963153ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae51fb6-4106-4610-92ba-deb10d6021f9', 'volume_name': 'volume-5ae51fb6-4106-4610-92ba-deb10d6021f9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d30bc0c-97ec-4f72-9789-fb1f0bbf4cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d30bc0c-97ec-4f72-9789-fb1f0bbf4cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9878630d-b495-4f9d-814f-0f8c4a34b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Volume 5ae51fb6-4106-4610-92ba-deb10d6021f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae51fb6-4106-4610-92ba-deb10d6021f9', 'volume_size': 1} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9045c88-d06f-4de7-80eb-492fb84a137c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b7f5149-23b7-42d6-a2a9-4c931668b53c', 'volume_name': 'volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c', 'volume_size': 1, 'image_id': '23eec84c-ced1-440d-b731-bb2701cd98be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23eec84c-ced1-440d-b731-bb2701cd98be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1c05094ed97882111545ba615464ac9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af615657640e4c9c9adf53740cb358b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a80f3e4746ff0e1a5e7f693be4f8182bf428aeb3798e3807ee801e0f15ec22ed5a0df5f75b4d67c4edb3d32dfb96bbd41f9e84cd42750c1ea625e5e87f87f6e6', 'id': '23eec84c-ced1-440d-b731-bb2701cd98be', 'created_at': datetime.datetime(2026, 9, 8, 5, 39, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 39, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23eec84c-ced1-440d-b731-bb2701cd98be/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3b0735-2f1b-4e21-823f-1b1ef9bf632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3b0735-2f1b-4e21-823f-1b1ef9bf632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f499e00-3a34-46e0-91bc-5a4952fb190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Volume 6b7f5149-23b7-42d6-a2a9-4c931668b53c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c', 'volume_size': 1, 'image_id': '23eec84c-ced1-440d-b731-bb2701cd98be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23eec84c-ced1-440d-b731-bb2701cd98be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1c05094ed97882111545ba615464ac9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af615657640e4c9c9adf53740cb358b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a80f3e4746ff0e1a5e7f693be4f8182bf428aeb3798e3807ee801e0f15ec22ed5a0df5f75b4d67c4edb3d32dfb96bbd41f9e84cd42750c1ea625e5e87f87f6e6', 'id': '23eec84c-ced1-440d-b731-bb2701cd98be', 'created_at': datetime.datetime(2026, 9, 8, 5, 39, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 39, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23eec84c-ced1-440d-b731-bb2701cd98be/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Trying to clone 6b7f5149-23b7-42d6-a2a9-4c931668b53c from image 23eec84c-ced1-440d-b731-bb2701cd98be at location (None, [{'url': 'file:///opt/stack/data/glance/images/23eec84c-ced1-440d-b731-bb2701cd98be', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:39:18 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Image download 0.00 MB at 0.00 MB/s Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8da183c-3dee-43f8-8dcd-7014a08c3fca]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:18 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5 1073741824" returned: 0 in 0.459s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:18 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD Sep 08 07:39:18 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:18 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5 Sep 08 07:39:18 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:18 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:18 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5" returned: 0 in 0.271s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.340s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233045793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174d8cfa-4f55-462b-8fea-205527686bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f2b683f17b49fcb002deaaf974f8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:15Z,use_quota=True,user_id='03af186dc6a340b98d845edf910e1ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Creating volume 174d8cfa-4f55-462b-8fea-205527686bec {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:18 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:18 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec 1073741824 Sep 08 07:39:18 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a60089-5830-4fd6-90d8-04e041a5c842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2053210f-4a89-43d8-910d-391872b225f5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc71db0d-d934-4c93-a6f7-10facdbfbd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:18 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Volume volume-2053210f-4a89-43d8-910d-391872b225f5 (2053210f-4a89-43d8-910d-391872b225f5): created successfully Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc71db0d-d934-4c93-a6f7-10facdbfbd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (f6d69162-4be7-4889-ba04-e00eae0b3cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:18 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ff648b8c-658e-405a-b763-17e47b810c7a tempest-CreateVolumesFromImageTest-855382389 None] Created volume successfully. Sep 08 07:39:18 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD Sep 08 07:39:18 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:18 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Temporary image 23eec84c-ced1-440d-b731-bb2701cd98be is fetched for user a1a20105ad014b34baeed582d43d1aa4. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb1371c-e62c-4f74-8258-18e656b20a9d]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:19 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec 1073741824" returned: 0 in 0.467s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:19 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD Sep 08 07:39:19 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:19 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec Sep 08 07:39:19 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:19 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:19 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec" returned: 0 in 0.245s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.860s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2066dac-b0b5-4e58-ad5e-dd720f6f0e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-174d8cfa-4f55-462b-8fea-205527686bec', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6984f54e-5b0c-4701-8f48-97eb769be7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Creating offline snapshot 9aff11d3-46c2-4e28-902a-d09c036958c7 of volume 7fba9f54-ef95-4a93-b890-00acac59b81d {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:39:19 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Volume volume-174d8cfa-4f55-462b-8fea-205527686bec (174d8cfa-4f55-462b-8fea-205527686bec): created successfully Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6984f54e-5b0c-4701-8f48-97eb769be7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Flow 'volume_create_manager' (9d7336bb-3eec-4120-b7fa-3f525241c874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95f00e0-094a-43d8-8b58-04dc5992e13c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-24436be5-1799-4b0c-896d-ff8603933626 tempest-CreateVolumesFromImageTest-855382389 None] Created volume successfully. Sep 08 07:39:19 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD Sep 08 07:39:19 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:19 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d Sep 08 07:39:19 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-174d8cfa-4f55-462b-8fea-205527686bec-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-174d8cfa-4f55-462b-8fea-205527686bec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-quobyte-174d8cfa-4f55-462b-8fea-205527686bec" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-174d8cfa-4f55-462b-8fea-205527686bec" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:19 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e608a126-cc93-48de-8b24-af7a2452f0da]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:19 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d" returned: 0 in 0.420s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:19 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec Sep 08 07:39:19 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:19 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 1G Sep 08 07:39:19 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:20 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec" returned: 0 in 0.383s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:20 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec Sep 08 07:39:20 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:20 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 1G" returned: 0 in 0.421s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fba9f54-ef95-4a93-b890-00acac59b81d -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:20 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fba9f54-ef95-4a93-b890-00acac59b81d -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 Sep 08 07:39:20 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:20 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-174d8cfa-4f55-462b-8fea-205527686bec" returned: 0 in 0.263s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-174d8cfa-4f55-462b-8fea-205527686bec" released by "delete_volume" :: held 0.695s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Created reservations ['50f098bd-4154-417f-8475-1bbf91b9b790', '63650900-ccbf-4f56-98af-ec9f1b695675', 'a64932c0-c5cc-4220-ae5e-b1471c064ac2', '86f799a0-3b4b-41c5-8d35-7446c3acd398'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:20 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:20 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:20 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fba9f54-ef95-4a93-b890-00acac59b81d -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7" returned: 0 in 0.298s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:20 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 is being set with open permissions: ugo+rw Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:20 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 Sep 08 07:39:20 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:20 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.255s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Deleted volume successfully. Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5488d44d-0111-4a87-b831-7347b1595e9a tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-174d8cfa-4f55-462b-8fea-205527686bec-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:20 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7" returned: 0 in 0.272s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:20 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.info Sep 08 07:39:20 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-2053210f-4a89-43d8-910d-391872b225f5-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-2053210f-4a89-43d8-910d-391872b225f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-quobyte-2053210f-4a89-43d8-910d-391872b225f5" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-2053210f-4a89-43d8-910d-391872b225f5" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:21 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.info" returned: 0 in 0.288s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:21 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.info is being set with open permissions: ugo+rw Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b33e67e-1204-403f-9587-f48be28b815e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:21 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.info Sep 08 07:39:21 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:21 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5 Sep 08 07:39:21 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:21 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.info" returned: 0 in 0.249s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.410s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-708024273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae51fb6-4106-4610-92ba-deb10d6021f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c0aa0d086e4588885b4681e8f25c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:18Z,use_quota=True,user_id='a402b9a76cb349b3801e9d35832a9ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Creating volume 5ae51fb6-4106-4610-92ba-deb10d6021f9 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:21 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:21 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 1073741824 Sep 08 07:39:21 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:21 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9eb7d4fd-5c3a-4536-a041-2844b10d91d7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Create snapshot completed successfully Sep 08 07:39:21 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5" returned: 0 in 0.384s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:21 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5 Sep 08 07:39:21 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:21 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2053210f-4a89-43d8-910d-391872b225f5" returned: 0 in 0.278s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-2053210f-4a89-43d8-910d-391872b225f5" released by "delete_volume" :: held 0.706s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Created reservations ['a9ee9dd8-a431-4c06-9f57-495e900a0068', '31ce4bd5-f474-44dc-ab67-ec20a66bfc2f', '139d2673-727b-4097-850f-cc092cfedf5d', '966cb4dc-20f1-46bc-ac22-c1b5a1becb86'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:21 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 1073741824" returned: 0 in 0.527s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:21 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:21 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:21 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 Sep 08 07:39:21 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-99ec7dcc-73e8-443f-a270-0a71d9e0701d-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:22 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.337s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-99ec7dcc-73e8-443f-a270-0a71d9e0701d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Deleted volume successfully. Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:22 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (f4a66384-a2ab-4b9a-b0b4-c1c5abfa1700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f0718d-ba59-479b-ac16-21e55c8daefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9" returned: 0 in 0.399s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.689s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7f5149-23b7-42d6-a2a9-4c931668b53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af615657640e4c9c9adf53740cb358b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:18Z,use_quota=True,user_id='a1a20105ad014b34baeed582d43d1aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27f9e561-cc87-40b1-95dc-bdf4836863eb),volume_type_id=27f9e561-cc87-40b1-95dc-bdf4836863eb)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Creating volume 6b7f5149-23b7-42d6-a2a9-4c931668b53c {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:22 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-29372862-949b-4988-929d-9ad9754614fc tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-2053210f-4a89-43d8-910d-391872b225f5-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f0718d-ba59-479b-ac16-21e55c8daefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1715000635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0dd233-bf1b-4641-8e01-83b810c3a43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:22Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c 1073741824 Sep 08 07:39:22 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2c046a-a8ff-49b8-9735-362300edcdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2c046a-a8ff-49b8-9735-362300edcdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3163c89b-7ec9-43c7-a3dc-39b9d70fe14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3163c89b-7ec9-43c7-a3dc-39b9d70fe14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f0dd233-bf1b-4641-8e01-83b810c3a43a', 'volume_name': 'volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c845e5c-0a4f-4473-b4c0-5229f34cbc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c845e5c-0a4f-4473-b4c0-5229f34cbc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2481df8e-ecea-4d1a-a769-a2b9d5d4062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume 6f0dd233-bf1b-4641-8e01-83b810c3a43a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a', 'volume_size': 1} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-quobyte-99ec7dcc-73e8-443f-a270-0a71d9e0701d" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9878630d-b495-4f9d-814f-0f8c4a34b20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae51fb6-4106-4610-92ba-deb10d6021f9', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4c3126-018d-4c73-90a4-b3d5f2182db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-99ec7dcc-73e8-443f-a270-0a71d9e0701d" acquired by "delete_volume" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:22 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Volume volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 (5ae51fb6-4106-4610-92ba-deb10d6021f9): created successfully Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4c3126-018d-4c73-90a4-b3d5f2182db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Flow 'volume_create_manager' (f8402fd9-445d-4c05-a766-c7b251431878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9adeb6-a754-452a-8268-b4cbe5cad690]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8c4039e1-7b59-432e-a1ae-04cf1c4e63ca tempest-CinderUnicodeTest-1491057004 None] Created volume successfully. Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (19f9fb24-a905-4462-a20d-04870f84c0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87c7aa1-8570-4693-b2c6-10b1f89a45f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d Sep 08 07:39:22 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87c7aa1-8570-4693-b2c6-10b1f89a45f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-614846871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2350c2-e88d-4dd0-98fc-331808fc2a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:23Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437b1de2-f56c-421a-b830-eddc41b5d7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437b1de2-f56c-421a-b830-eddc41b5d7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfedbe36-5ab7-4ea3-8b93-724ed353b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfedbe36-5ab7-4ea3-8b93-724ed353b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2350c2-e88d-4dd0-98fc-331808fc2a6b', 'volume_name': 'volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c54fed-4e68-48ad-bd36-bb7110320f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c54fed-4e68-48ad-bd36-bb7110320f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0652350-ec1b-48b1-83b5-3904f36580c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:22 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume ab2350c2-e88d-4dd0-98fc-331808fc2a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b', 'volume_size': 1} Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:22 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c 1073741824" returned: 0 in 0.612s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:23 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:23 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c Sep 08 07:39:23 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d" returned: 0 in 0.554s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:23 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d Sep 08 07:39:23 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (cadf9380-0aeb-4acb-b21a-32dca1f22cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67708c38-8b7d-4192-a1b5-a0f2e693fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67708c38-8b7d-4192-a1b5-a0f2e693fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1286773159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:23Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012d10ac-86df-4b40-9df9-0b2f79c8230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012d10ac-86df-4b40-9df9-0b2f79c8230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c892279-031d-4f8c-b1c0-24bfd381a0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c892279-031d-4f8c-b1c0-24bfd381a0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5', 'volume_name': 'volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b3b00c-bb79-44b5-b089-350d6daae6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b3b00c-bb79-44b5-b089-350d6daae6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885f2cd9-c5de-4ba6-99f5-191a4fd5e29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume 4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5', 'volume_size': 1} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:23 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c" returned: 0 in 0.362s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.961s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1715000635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0dd233-bf1b-4641-8e01-83b810c3a43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:22Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Creating volume 6f0dd233-bf1b-4641-8e01-83b810c3a43a {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:23 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:23 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a 1073741824 Sep 08 07:39:23 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Attempting download of 23eec84c-ced1-440d-b731-bb2701cd98be ((None, [{'url': 'file:///opt/stack/data/glance/images/23eec84c-ced1-440d-b731-bb2701cd98be', 'metadata': {}}])) to volume 6b7f5149-23b7-42d6-a2a9-4c931668b53c. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:39:23 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-99ec7dcc-73e8-443f-a270-0a71d9e0701d" returned: 0 in 0.500s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[43330764-bc9f-4927-84c4-004de00fe4cd]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23eec84c-ced1-440d-b731-bb2701cd98be_h63qinly {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-99ec7dcc-73e8-443f-a270-0a71d9e0701d" released by "delete_volume" :: held 1.171s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (2d0673d7-2a54-4d7f-bce4-485aafa48998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac511452-69df-4c85-bb0c-ba7e1294b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac511452-69df-4c85-bb0c-ba7e1294b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782597060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06246aea-ed01-40c8-8fd3-e63feccb5de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:24Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:23 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23eec84c-ced1-440d-b731-bb2701cd98be_h63qinly Sep 08 07:39:23 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccad52d-575b-4534-83b0-25578ee32414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccad52d-575b-4534-83b0-25578ee32414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56d4e03-dbee-4710-b3ea-ad79d8379a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56d4e03-dbee-4710-b3ea-ad79d8379a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06246aea-ed01-40c8-8fd3-e63feccb5de2', 'volume_name': 'volume-06246aea-ed01-40c8-8fd3-e63feccb5de2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23c5f83-6805-4c4c-93ff-6882c4c9f0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23c5f83-6805-4c4c-93ff-6882c4c9f0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe01e8c8-db8e-4ac9-9eb7-da208f21f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume 06246aea-ed01-40c8-8fd3-e63feccb5de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06246aea-ed01-40c8-8fd3-e63feccb5de2', 'volume_size': 1} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:23 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Created reservations ['c4823580-d968-4fb2-b29f-2780bc516d6b', '550ba4da-3834-4f63-8cf9-2365173c3614', '7922506f-d6e1-4eaf-8e05-016d32d6af10', 'f5a366f7-e6fd-4daa-8deb-6a8dade341b1'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:24 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23eec84c-ced1-440d-b731-bb2701cd98be_h63qinly" returned: 0 in 0.402s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23eec84c-ced1-440d-b731-bb2701cd98be_h63qinly {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:24 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:24 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:24 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a 1073741824" returned: 0 in 0.693s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (8dc97843-36aa-47c0-9064-9df0ec5d71ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce8b5c7-89a6-4708-9196-893a27cfe208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:24 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23eec84c-ced1-440d-b731-bb2701cd98be_h63qinly Sep 08 07:39:24 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:24 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a Sep 08 07:39:24 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce8b5c7-89a6-4708-9196-893a27cfe208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299039401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d992f541-492e-4c28-a176-f7f61aeb48e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:24Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4215a6-4b9e-432a-af91-2fecce477dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4215a6-4b9e-432a-af91-2fecce477dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328927da-c643-4d22-ac29-e2a047587b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328927da-c643-4d22-ac29-e2a047587b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd992f541-492e-4c28-a176-f7f61aeb48e2', 'volume_name': 'volume-d992f541-492e-4c28-a176-f7f61aeb48e2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bd3964-101e-4bc6-829c-2c57d08d8cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bd3964-101e-4bc6-829c-2c57d08d8cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7771a333-ef78-431b-85fd-85753cc6fc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:24 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume d992f541-492e-4c28-a176-f7f61aeb48e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d992f541-492e-4c28-a176-f7f61aeb48e2', 'volume_size': 1} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:24 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.281s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:24 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Deleted volume successfully. Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d5339f56-1537-4c12-b1cc-a7d38d9f49ae tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-99ec7dcc-73e8-443f-a270-0a71d9e0701d-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:24 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23eec84c-ced1-440d-b731-bb2701cd98be_h63qinly" returned: 1 in 0.356s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23eec84c-ced1-440d-b731-bb2701cd98be_h63qinly' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e31b31-f018-44cd-a886-449674dcb954]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:24 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a" returned: 0 in 0.265s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-614846871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2350c2-e88d-4dd0-98fc-331808fc2a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:23Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Creating volume ab2350c2-e88d-4dd0-98fc-331808fc2a6b {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:24 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2481df8e-ecea-4d1a-a769-a2b9d5d4062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:24 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b 1073741824 Sep 08 07:39:24 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1966fbb-b19d-4752-a211-f3d3202de285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:24 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a (6f0dd233-bf1b-4641-8e01-83b810c3a43a): created successfully Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1966fbb-b19d-4752-a211-f3d3202de285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (f4a66384-a2ab-4b9a-b0b4-c1c5abfa1700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:24 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD Sep 08 07:39:24 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:24 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f9da4f35-2428-4230-a26b-d0df72c15263 tempest-CreateVolumesFromSnapshotTest-523906847 None] Created volume successfully. Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-b62e8e00-40c9-418d-a021-c241d542c8bc-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-b62e8e00-40c9-418d-a021-c241d542c8bc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-quobyte-b62e8e00-40c9-418d-a021-c241d542c8bc" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-b62e8e00-40c9-418d-a021-c241d542c8bc" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:24 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd63e09-b474-40dc-899a-74c0f2eddde1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:24 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD Sep 08 07:39:24 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:24 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc Sep 08 07:39:24 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:24 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b 1073741824" returned: 0 in 0.512s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:25 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b Sep 08 07:39:25 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:25 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] 23eec84c-ced1-440d-b731-bb2701cd98be was raw, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:25 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c Sep 08 07:39:25 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:25 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc" returned: 0 in 0.473s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:25 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc Sep 08 07:39:25 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:25 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b" returned: 0 in 0.274s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.106s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1286773159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:23Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Creating volume 4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:25 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0652350-ec1b-48b1-83b5-3904f36580c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:25 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 1073741824 Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5b9e04-1e79-4e57-a0d4-eb27eecfdbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:25 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:25 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b (ab2350c2-e88d-4dd0-98fc-331808fc2a6b): created successfully Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5b9e04-1e79-4e57-a0d4-eb27eecfdbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (19f9fb24-a905-4462-a20d-04870f84c0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:25 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7652bef7-fe2e-49a0-a121-46ebe7909ed7 tempest-CreateVolumesFromSnapshotTest-523906847 None] Created volume successfully. Sep 08 07:39:25 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b62e8e00-40c9-418d-a021-c241d542c8bc" returned: 0 in 0.274s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-b62e8e00-40c9-418d-a021-c241d542c8bc" released by "delete_volume" :: held 0.799s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Created reservations ['baf1b2d5-6075-404e-b61a-8285d04ee462', 'd7e007a2-8a36-47d7-87ed-d595e1749ad9', '055a7347-b7e2-4052-b55c-a8b1c47b75ca', '922eb448-7e55-40ee-b595-45688cac3c0f'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:25 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c" returned: 0 in 0.474s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23eec84c-ced1-440d-b731-bb2701cd98be_di9etvuodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:39:25 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:25 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c 1G Sep 08 07:39:25 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:25 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:25 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-4d726ed3-c826-4585-98dd-d57264e4ae5a-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:25 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 1073741824" returned: 0 in 0.525s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-4d726ed3-c826-4585-98dd-d57264e4ae5a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "cinder-quobyte-4d726ed3-c826-4585-98dd-d57264e4ae5a" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:25 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 Sep 08 07:39:25 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:26 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-4d726ed3-c826-4585-98dd-d57264e4ae5a" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.298s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Deleted volume successfully. Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c66a23-6090-4e71-93c1-c1ea90c2e43c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-32d9192f-2156-47a8-a9bd-1c1af6baee4b tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-b62e8e00-40c9-418d-a021-c241d542c8bc-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:26 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c 1G" returned: 0 in 0.417s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Downloaded image 23eec84c-ced1-440d-b731-bb2701cd98be ((None, [{'url': 'file:///opt/stack/data/glance/images/23eec84c-ced1-440d-b731-bb2701cd98be', 'metadata': {}}])) to volume 6b7f5149-23b7-42d6-a2a9-4c931668b53c successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Temporary image 23eec84c-ced1-440d-b731-bb2701cd98be for user a1a20105ad014b34baeed582d43d1aa4 is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Marking volume 6b7f5149-23b7-42d6-a2a9-4c931668b53c as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Copying metadata from image 23eec84c-ced1-440d-b731-bb2701cd98be to 6b7f5149-23b7-42d6-a2a9-4c931668b53c. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Creating volume glance metadata for volume 6b7f5149-23b7-42d6-a2a9-4c931668b53c backed by image 23eec84c-ced1-440d-b731-bb2701cd98be with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '23eec84c-ced1-440d-b731-bb2701cd98be', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a1c05094ed97882111545ba615464ac9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f499e00-3a34-46e0-91bc-5a4952fb190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c', 'volume_size': 1, 'image_id': '23eec84c-ced1-440d-b731-bb2701cd98be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23eec84c-ced1-440d-b731-bb2701cd98be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1c05094ed97882111545ba615464ac9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af615657640e4c9c9adf53740cb358b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a80f3e4746ff0e1a5e7f693be4f8182bf428aeb3798e3807ee801e0f15ec22ed5a0df5f75b4d67c4edb3d32dfb96bbd41f9e84cd42750c1ea625e5e87f87f6e6', 'id': '23eec84c-ced1-440d-b731-bb2701cd98be', 'created_at': datetime.datetime(2026, 9, 8, 5, 39, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 39, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23eec84c-ced1-440d-b731-bb2701cd98be/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:26 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a Sep 08 07:39:26 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975db1b1-92dd-4527-a36c-6a070a471bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Volume volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c (6b7f5149-23b7-42d6-a2a9-4c931668b53c): created successfully Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975db1b1-92dd-4527-a36c-6a070a471bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Flow 'volume_create_manager' (1188740c-5fbe-4e58-be28-a7699721bc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c779ebb2-1ac8-44e9-83c7-b711c5c38445 tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Created volume successfully. Sep 08 07:39:26 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5" returned: 0 in 0.320s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.585s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885f2cd9-c5de-4ba6-99f5-191a4fd5e29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6474de6-1e38-4efc-aabb-342ad74bfeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Creating offline snapshot 54a2649b-2727-4394-9dee-cac43a7fd38f of volume 5ae51fb6-4106-4610-92ba-deb10d6021f9 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:39:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 (4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5): created successfully Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6474de6-1e38-4efc-aabb-342ad74bfeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (cadf9380-0aeb-4acb-b21a-32dca1f22cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a3bd2f-2637-4145-bd22-5572cbdb477a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3c71cd12-245d-4286-a303-45764600aeb4 tempest-CreateVolumesFromSnapshotTest-523906847 None] Created volume successfully. Sep 08 07:39:26 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a" returned: 0 in 0.418s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:26 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 Sep 08 07:39:26 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:26 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a Sep 08 07:39:26 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:26 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4d726ed3-c826-4585-98dd-d57264e4ae5a" returned: 0 in 0.270s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-quobyte-4d726ed3-c826-4585-98dd-d57264e4ae5a" released by "delete_volume" :: held 0.732s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:26 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:26 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f 1G Sep 08 07:39:26 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Created reservations ['931d3e9e-0c10-4b86-995c-3de638886b03', 'da2a5070-344e-451a-8638-c930eda9373a', '3c05353c-4640-40a8-af2c-7076e6966f97', 'ad8a632d-3ac3-4be9-8b96-537235f0786a'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:26 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:26 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:27 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.326s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Deleted volume successfully. Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ee2eb37f-829c-4957-9f69-94fb21e37305 tempest-CreateVolumesFromImageTest-855382389 None] Lock "cinder-4d726ed3-c826-4585-98dd-d57264e4ae5a-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:27 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f 1G" returned: 0 in 0.521s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:27 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f Sep 08 07:39:27 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Acquiring lock "cinder-6b7f5149-23b7-42d6-a2a9-4c931668b53c-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "cinder-6b7f5149-23b7-42d6-a2a9-4c931668b53c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Acquiring lock "cinder-quobyte-6b7f5149-23b7-42d6-a2a9-4c931668b53c" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "cinder-quobyte-6b7f5149-23b7-42d6-a2a9-4c931668b53c" acquired by "delete_volume" :: waited 0.022s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a0efb8-eda2-431d-9896-71e4b547ed84]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:27 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c Sep 08 07:39:27 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:27 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f" returned: 0 in 0.391s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:27 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f is being set with open permissions: ugo+rw Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:27 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f Sep 08 07:39:27 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:27 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c" returned: 0 in 0.385s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:27 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c Sep 08 07:39:27 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:27 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f" returned: 0 in 0.286s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:28 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.info Sep 08 07:39:28 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:28 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6b7f5149-23b7-42d6-a2a9-4c931668b53c" returned: 0 in 0.299s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "cinder-quobyte-6b7f5149-23b7-42d6-a2a9-4c931668b53c" released by "delete_volume" :: held 0.748s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Created reservations ['80bf6574-fac1-449c-a94b-e55ad8268887', 'ea07bb4c-dcde-466c-b66f-2d3956421b70', '2b118319-2e9d-4b16-91a1-8a50c8d3e029', '1151bcfd-570a-4dde-a13f-abfdef222503'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:28 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.info" returned: 0 in 0.318s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:28 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.info is being set with open permissions: ugo+rw Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:28 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:28 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:28 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.info Sep 08 07:39:28 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:28 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.327s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:28 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Deleted volume successfully. Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b1ae7c54-ccb0-46f9-b0ca-27877bcae46e tempest-VolumeAndVolumeTypeFromImageTest-1681250087 None] Lock "cinder-6b7f5149-23b7-42d6-a2a9-4c931668b53c-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:28 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.info" returned: 0 in 0.374s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.891s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782597060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06246aea-ed01-40c8-8fd3-e63feccb5de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:24Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Creating volume 06246aea-ed01-40c8-8fd3-e63feccb5de2 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:28 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:28 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 1073741824 Sep 08 07:39:28 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:28 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bc2508e1-5482-464f-af64-9986bf108c33 tempest-CinderUnicodeTest-1491057004 None] Create snapshot completed successfully Sep 08 07:39:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "cinder-54a2649b-2727-4394-9dee-cac43a7fd38f-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-54a2649b-2727-4394-9dee-cac43a7fd38f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "cinder-quobyte-5ae51fb6-4106-4610-92ba-deb10d6021f9" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-quobyte-5ae51fb6-4106-4610-92ba-deb10d6021f9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "cinder-quobyte-54a2649b-2727-4394-9dee-cac43a7fd38f" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-quobyte-54a2649b-2727-4394-9dee-cac43a7fd38f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Deleting offline snapshot 54a2649b-2727-4394-9dee-cac43a7fd38f of volume 5ae51fb6-4106-4610-92ba-deb10d6021f9 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] snapshot_file for this snap is: volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[052b5a5e-8502-4472-9e90-0c3e7e11d4d5]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:29 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f Sep 08 07:39:29 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:29 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 1073741824" returned: 0 in 0.604s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:29 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 Sep 08 07:39:29 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:29 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f" returned: 0 in 0.497s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae51fb6-4106-4610-92ba-deb10d6021f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b31bdfe-9dd2-43b9-92c7-1444fa5a50a2]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:29 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2" returned: 0 in 0.356s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.495s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299039401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d992f541-492e-4c28-a176-f7f61aeb48e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbf4eed0a08426f90e669d36d413da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:24Z,use_quota=True,user_id='bb556bebc4764218bc1e68bf154b1f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Creating volume d992f541-492e-4c28-a176-f7f61aeb48e2 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:29 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:29 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 Sep 08 07:39:29 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe01e8c8-db8e-4ac9-9eb7-da208f21f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06246aea-ed01-40c8-8fd3-e63feccb5de2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:29 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2 1073741824 Sep 08 07:39:29 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397d9906-5c1f-4052-9ba8-47740d344103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:29 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 (06246aea-ed01-40c8-8fd3-e63feccb5de2): created successfully Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397d9906-5c1f-4052-9ba8-47740d344103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (2d0673d7-2a54-4d7f-bce4-485aafa48998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:29 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-59a43cea-46c6-4e0c-acd5-ed77f951e1c2 tempest-CreateVolumesFromSnapshotTest-523906847 None] Created volume successfully. Sep 08 07:39:30 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9" returned: 0 in 0.513s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:30 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f Sep 08 07:39:30 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:30 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2 1073741824" returned: 0 in 0.614s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:30 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2 Sep 08 07:39:30 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:30 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f" returned: 0 in 0.466s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:30 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f Sep 08 07:39:30 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:30 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2" returned: 0 in 0.339s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7771a333-ef78-431b-85fd-85753cc6fc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d992f541-492e-4c28-a176-f7f61aeb48e2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ab1d64-56e7-4555-9d1b-db839cb74879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:30 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Volume volume-d992f541-492e-4c28-a176-f7f61aeb48e2 (d992f541-492e-4c28-a176-f7f61aeb48e2): created successfully Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ab1d64-56e7-4555-9d1b-db839cb74879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Flow 'volume_create_manager' (8dc97843-36aa-47c0-9064-9df0ec5d71ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:30 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4d39ff46-efc8-4825-84d8-e8ac28447eb8 tempest-CreateVolumesFromSnapshotTest-523906847 None] Created volume successfully. Sep 08 07:39:30 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9.54a2649b-2727-4394-9dee-cac43a7fd38f" returned: 0 in 0.322s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-quobyte-54a2649b-2727-4394-9dee-cac43a7fd38f" released by "_delete_snapshot" :: held 1.918s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:30 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-quobyte-5ae51fb6-4106-4610-92ba-deb10d6021f9" released by "delete_snapshot" :: held 1.943s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Created reservations ['b9f3cd8e-c60f-47b6-b904-f36455834498', 'd8d5bfbb-8761-4b67-817d-153f75d86c34', '832161b3-3702-460b-8302-165f61a78935', '7533ff39-5b89-4c89-bbb8-8eee58f28f38'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:31 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Delete snapshot completed successfully. Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-90962529-575c-4931-8174-0571aba7558d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-54a2649b-2727-4394-9dee-cac43a7fd38f-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "cinder-5ae51fb6-4106-4610-92ba-deb10d6021f9-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-5ae51fb6-4106-4610-92ba-deb10d6021f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (52843c84-fca3-4219-ab2d-579c7fa55c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005de775-566f-480a-a8c0-0906df0f9966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005de775-566f-480a-a8c0-0906df0f9966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607262324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01194f20-fb37-437f-8834-4b5eeb377d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:31Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81594ea6-c8c9-4171-971a-c5f635296bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81594ea6-c8c9-4171-971a-c5f635296bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e687c48e-05a6-49a3-8427-145769bafc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e687c48e-05a6-49a3-8427-145769bafc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01194f20-fb37-437f-8834-4b5eeb377d81', 'volume_name': 'volume-01194f20-fb37-437f-8834-4b5eeb377d81', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704593f2-dcd0-4f62-90d4-845b80ad3bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704593f2-dcd0-4f62-90d4-845b80ad3bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23a1c64-64dc-451f-acbb-8e0da80531cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:31 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume 01194f20-fb37-437f-8834-4b5eeb377d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01194f20-fb37-437f-8834-4b5eeb377d81', 'volume_size': 1} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607262324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01194f20-fb37-437f-8834-4b5eeb377d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:31Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Creating volume 01194f20-fb37-437f-8834-4b5eeb377d81 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:31 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "cinder-quobyte-5ae51fb6-4106-4610-92ba-deb10d6021f9" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:31 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81 1073741824 Sep 08 07:39:31 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-quobyte-5ae51fb6-4106-4610-92ba-deb10d6021f9" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf71fb7-204b-42a1-a5e5-b0816effd86d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:31 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 Sep 08 07:39:31 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:31 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81 1073741824" returned: 0 in 0.473s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:31 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9" returned: 0 in 0.405s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:31 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9 Sep 08 07:39:31 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:31 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81 Sep 08 07:39:31 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-d992f541-492e-4c28-a176-f7f61aeb48e2-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-d992f541-492e-4c28-a176-f7f61aeb48e2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-quobyte-d992f541-492e-4c28-a176-f7f61aeb48e2" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-d992f541-492e-4c28-a176-f7f61aeb48e2" acquired by "delete_volume" :: waited 0.028s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:32 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-5ae51fb6-4106-4610-92ba-deb10d6021f9" returned: 0 in 0.388s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[116fbc16-4eca-42e4-939a-23c62dd1709e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-quobyte-5ae51fb6-4106-4610-92ba-deb10d6021f9" released by "delete_volume" :: held 0.885s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:32 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81" returned: 0 in 0.424s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23a1c64-64dc-451f-acbb-8e0da80531cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01194f20-fb37-437f-8834-4b5eeb377d81', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e61010d-82a5-40e5-a9f6-ced85165378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:32 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume volume-01194f20-fb37-437f-8834-4b5eeb377d81 (01194f20-fb37-437f-8834-4b5eeb377d81): created successfully Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e61010d-82a5-40e5-a9f6-ced85165378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (52843c84-fca3-4219-ab2d-579c7fa55c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:32 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2 Sep 08 07:39:32 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Created reservations ['4fb61412-2978-4538-8ae0-0cc0aa83edad', '773b3ff0-10a3-46c0-a0e1-6ebb0a179e95', '67c46a19-2cd0-4cb6-89f9-0452c15dec44', 'c0028fcc-4788-4d75-aeb2-8765cb1ca795'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1e7cf021-2a87-4161-a288-01287f91b332 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created volume successfully. Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:32 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:32 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:32 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2" returned: 0 in 0.402s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:32 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2 Sep 08 07:39:32 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:32 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.268s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Deleted volume successfully. Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0358cedb-0f60-440c-b5bc-b98e1f7ec26d tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-5ae51fb6-4106-4610-92ba-deb10d6021f9-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:32 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d992f541-492e-4c28-a176-f7f61aeb48e2" returned: 0 in 0.287s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-d992f541-492e-4c28-a176-f7f61aeb48e2" released by "delete_volume" :: held 0.813s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:32 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Created reservations ['66023b5b-3b2f-4eb4-9039-4028379b02f5', '68bd17ab-e2e5-40b3-88a4-aff1d7d2d383', 'c7fd7547-e9e9-4d72-97b4-5143da13fd27', '206dfacf-6d3e-4349-a038-18713c5bdcd7'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:33 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:33 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-06246aea-ed01-40c8-8fd3-e63feccb5de2-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-06246aea-ed01-40c8-8fd3-e63feccb5de2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:33 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.279s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-quobyte-06246aea-ed01-40c8-8fd3-e63feccb5de2" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:33 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Deleted volume successfully. Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-06246aea-ed01-40c8-8fd3-e63feccb5de2" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7fc31db6-9e3e-4022-9c9d-ec25f76d4fbb tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-d992f541-492e-4c28-a176-f7f61aeb48e2-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886d82a-5167-47c2-9f39-b246ce13a8b8]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "cinder-bc709d9f-6985-4f67-87f9-8787fcf96ca0-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-bc709d9f-6985-4f67-87f9-8787fcf96ca0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:33 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 Sep 08 07:39:33 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "cinder-quobyte-bc709d9f-6985-4f67-87f9-8787fcf96ca0" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-quobyte-bc709d9f-6985-4f67-87f9-8787fcf96ca0" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f6589b-94d3-405f-a1f5-27cf187fd85a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:33 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 Sep 08 07:39:33 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:33 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2" returned: 0 in 0.500s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:33 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2 Sep 08 07:39:33 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (d1bc65c6-8d5a-42f0-987e-6d39072b8d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3729c3-3aee-4971-938c-006f8a53d324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3729c3-3aee-4971-938c-006f8a53d324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441283037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:34Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcb488b-8e0a-416a-9dbe-f6b7a822e59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcb488b-8e0a-416a-9dbe-f6b7a822e59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fbbbbb-3f5b-48ec-9b99-5bc278222abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fbbbbb-3f5b-48ec-9b99-5bc278222abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4', 'volume_name': 'volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:34 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9319fbc-b8ec-489a-bc75-50eb92633b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9319fbc-b8ec-489a-bc75-50eb92633b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6258eeb2-c01d-4ab6-99d5-f2787ce765a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume 3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4', 'volume_size': 1} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441283037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:34Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Creating volume 3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:34 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0" returned: 0 in 0.672s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-06246aea-ed01-40c8-8fd3-e63feccb5de2" returned: 0 in 0.379s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:34 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 1073741824 Sep 08 07:39:34 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:34 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0 Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-06246aea-ed01-40c8-8fd3-e63feccb5de2" released by "delete_volume" :: held 0.970s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:34 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Created reservations ['5892a6d4-28f4-44cb-887d-925f6fa12f03', '123a09e2-c301-47ab-8901-e86f71220c86', '34c95341-39ec-4fdf-a1ef-7fd34969305d', 'b2a6f9fd-5851-448e-a5d2-e91795410cf8'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:34 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:34 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (24a2ab4d-1805-4627-9ae6-81f260265404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5893cdca-9ea6-446c-905c-d94b79b71d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5893cdca-9ea6-446c-905c-d94b79b71d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-943798440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cae85e-c1b8-48e8-909f-228dff0326be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:35Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0899a5fa-6bbf-447d-a7cb-7f9401d3b309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0899a5fa-6bbf-447d-a7cb-7f9401d3b309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48041cc-46ca-402d-9db1-f945ad69402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48041cc-46ca-402d-9db1-f945ad69402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9cae85e-c1b8-48e8-909f-228dff0326be', 'volume_name': 'volume-c9cae85e-c1b8-48e8-909f-228dff0326be', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ece632-c6ea-41f7-95c2-714f843c058d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ece632-c6ea-41f7-95c2-714f843c058d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411f970b-2b57-49e6-8412-7529d0635ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:34 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume c9cae85e-c1b8-48e8-909f-228dff0326be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9cae85e-c1b8-48e8-909f-228dff0326be', 'volume_size': 1} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:34 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bc709d9f-6985-4f67-87f9-8787fcf96ca0" returned: 0 in 0.540s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-quobyte-bc709d9f-6985-4f67-87f9-8787fcf96ca0" released by "delete_volume" :: held 1.281s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Created reservations ['4530d635-0910-4f3f-9a10-49eb16947096', 'c708f771-9187-4122-9c7e-a3d69d874cd1', '9026897e-63d5-48ba-a325-82990878d0e4', '922ea8d9-2e63-4ca6-815b-acd5370d88bc'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:35 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.442s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:35 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 1073741824" returned: 0 in 0.778s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Deleted volume successfully. Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-87c9cec2-d195-4400-bb70-abaf95966b3b tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-06246aea-ed01-40c8-8fd3-e63feccb5de2-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:35 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:35 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3c18c642-a4f9-412c-aa03-d9a0ab9358c7 tempest-ProjectAdminTests-1905510432 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.531265258789, 'free_capacity_gb': 1773.531265258789, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87278) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:35 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:35 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (4304c270-5492-469e-b194-34252e506241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49190749-d1ad-4ed5-93cd-bef3988d3e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49190749-d1ad-4ed5-93cd-bef3988d3e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585906601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceadc780-d7a6-4534-bb13-92a9275e68c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:35Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2296d6-f353-4880-906d-d31b827017e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2296d6-f353-4880-906d-d31b827017e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53258eea-8b0d-4b75-aad1-e5a47c67bef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53258eea-8b0d-4b75-aad1-e5a47c67bef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceadc780-d7a6-4534-bb13-92a9275e68c0', 'volume_name': 'volume-ceadc780-d7a6-4534-bb13-92a9275e68c0', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0532ba2e-6539-470c-8b43-b34d3e2360c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0532ba2e-6539-470c-8b43-b34d3e2360c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39afdf15-f295-49a6-a91b-c8434c575ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:35 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume ceadc780-d7a6-4534-bb13-92a9275e68c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceadc780-d7a6-4534-bb13-92a9275e68c0', 'volume_size': 1} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-quobyte-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e328f87-20fd-45df-bff7-d693606dc21e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:35 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.392s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Deleted volume successfully. Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a2042e8f-a392-4831-b1df-879e6d5253a8 tempest-CinderUnicodeTest-1491057004 None] Lock "cinder-bc709d9f-6985-4f67-87f9-8787fcf96ca0-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:35 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 Sep 08 07:39:35 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:35 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4" returned: 0 in 0.526s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.941s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-943798440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cae85e-c1b8-48e8-909f-228dff0326be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:35Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Creating volume c9cae85e-c1b8-48e8-909f-228dff0326be {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:35 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:35 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be 1073741824 Sep 08 07:39:35 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6258eeb2-c01d-4ab6-99d5-f2787ce765a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0f7c1c-2f4a-457f-9401-a21d16700410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (610f884e-da6f-4d29-a312-1b2a7852c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f417621d-f9f2-46db-8490-ad21731c8b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:35 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 (3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4): created successfully Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0f7c1c-2f4a-457f-9401-a21d16700410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (d1bc65c6-8d5a-42f0-987e-6d39072b8d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f417621d-f9f2-46db-8490-ad21731c8b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870297737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfe9c59-684d-4f6a-8392-adb90926040f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:36Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652d77fc-6ec9-499f-9385-3014351fff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652d77fc-6ec9-499f-9385-3014351fff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee45a0d5-7f61-4810-8a84-0adb4376a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee45a0d5-7f61-4810-8a84-0adb4376a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adfe9c59-684d-4f6a-8392-adb90926040f', 'volume_name': 'volume-adfe9c59-684d-4f6a-8392-adb90926040f', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5e40f4-93f8-4003-9372-33a2cfa9a884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5e40f4-93f8-4003-9372-33a2cfa9a884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8030e0fc-a3ed-419f-a5ad-29a99361eed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume adfe9c59-684d-4f6a-8392-adb90926040f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adfe9c59-684d-4f6a-8392-adb90926040f', 'volume_size': 1} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:36 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-75ae310e-b64f-4323-b3c3-e46ea3cfca26 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created volume successfully. Sep 08 07:39:36 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5" returned: 0 in 0.639s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:36 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5 Sep 08 07:39:36 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:36 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be 1073741824" returned: 0 in 0.672s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:36 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5" released by "delete_volume" :: held 1.075s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (ace416d9-e88e-4aaa-b8ce-a16b12dc4d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07670e17-35ad-4122-98e2-5ab2ac85b9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07670e17-35ad-4122-98e2-5ab2ac85b9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563568736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:36Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b8dd68-d3bd-4de0-be87-9ff325a369e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b8dd68-d3bd-4de0-be87-9ff325a369e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:36 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be Sep 08 07:39:36 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1fe7a7-1403-43db-9769-b6b9089539ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1fe7a7-1403-43db-9769-b6b9089539ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c', 'volume_name': 'volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908f1d30-9b5d-4350-a532-ebb150ef3f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908f1d30-9b5d-4350-a532-ebb150ef3f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0a870c-ed42-4918-bed1-e2f27d7d4b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c', 'volume_size': 1} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Created reservations ['bd41f361-937d-4f98-8a1f-cbf70c919e11', '7cb00114-e4aa-43ce-b052-85920b73964e', '4ce3272c-84b1-4919-9432-677c749afa8f', '4d284bd4-e0e4-4830-bddc-50a2d9fe73b0'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:36 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:36 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:36 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.525s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585906601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceadc780-d7a6-4534-bb13-92a9275e68c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:35Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Creating volume ceadc780-d7a6-4534-bb13-92a9275e68c0 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:36 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411f970b-2b57-49e6-8412-7529d0635ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9cae85e-c1b8-48e8-909f-228dff0326be', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:36 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8160f81b-217d-489b-b9ca-972b748a1e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:36 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 1073741824 Sep 08 07:39:36 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:37 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume volume-c9cae85e-c1b8-48e8-909f-228dff0326be (c9cae85e-c1b8-48e8-909f-228dff0326be): created successfully Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8160f81b-217d-489b-b9ca-972b748a1e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (24a2ab4d-1805-4627-9ae6-81f260265404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-758e4cb1-8d10-4913-8d7d-a8299ae2c263 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created volume successfully. Sep 08 07:39:37 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.382s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Deleted volume successfully. Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-e299b688-d91d-4228-b9eb-9f74fc74a99e tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-4ae6ce91-2e4f-4650-ba6f-241ded9fd6f5-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:37 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 1073741824" returned: 0 in 0.610s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-ab2350c2-e88d-4dd0-98fc-331808fc2a6b-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:37 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 Sep 08 07:39:37 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-ab2350c2-e88d-4dd0-98fc-331808fc2a6b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-quobyte-ab2350c2-e88d-4dd0-98fc-331808fc2a6b" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-ab2350c2-e88d-4dd0-98fc-331808fc2a6b" acquired by "delete_volume" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[959167b9-6d13-4845-a456-216396964ae7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:37 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b Sep 08 07:39:37 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:37 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870297737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfe9c59-684d-4f6a-8392-adb90926040f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:36Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Creating volume adfe9c59-684d-4f6a-8392-adb90926040f {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:38 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:38 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f 1073741824 Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39afdf15-f295-49a6-a91b-c8434c575ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceadc780-d7a6-4534-bb13-92a9275e68c0', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:38 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f8cfe6-bf71-4f54-b486-1e8d2be36870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:38 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 (ceadc780-d7a6-4534-bb13-92a9275e68c0): created successfully Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f8cfe6-bf71-4f54-b486-1e8d2be36870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (4304c270-5492-469e-b194-34252e506241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-34778be3-4ac1-435e-87a2-6b18d0f7eaa2 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created volume successfully. Sep 08 07:39:38 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b" returned: 0 in 0.514s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:38 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b Sep 08 07:39:38 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:38 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f 1073741824" returned: 0 in 0.562s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:38 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ab2350c2-e88d-4dd0-98fc-331808fc2a6b" returned: 0 in 0.383s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:38 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f Sep 08 07:39:38 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-ab2350c2-e88d-4dd0-98fc-331808fc2a6b" released by "delete_volume" :: held 0.956s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Created reservations ['c056d269-e3cb-4e18-9c00-4e1aa9d2445d', '6e9ca6d4-372c-4768-862a-0cf534b89ddd', '0bbd121d-4a24-4d0f-993c-179cf1e61dd3', 'ebb966db-f6f5-4970-a8bc-e11c290ba49b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:38 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:38 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:38 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f" returned: 0 in 0.318s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563568736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0700e4e1457e42efa181d696734ed977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:36Z,use_quota=True,user_id='011047e47efa49f39b06a089546973a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Creating volume fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:39 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:39 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c 1073741824 Sep 08 07:39:39 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8030e0fc-a3ed-419f-a5ad-29a99361eed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adfe9c59-684d-4f6a-8392-adb90926040f', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be888d9-97af-4446-93bd-5b0bdb857c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:39 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume volume-adfe9c59-684d-4f6a-8392-adb90926040f (adfe9c59-684d-4f6a-8392-adb90926040f): created successfully Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be888d9-97af-4446-93bd-5b0bdb857c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (610f884e-da6f-4d29-a312-1b2a7852c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:39 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ac4a0154-1224-40f8-a346-e031d2b7f6ac tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created volume successfully. Sep 08 07:39:39 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.405s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:39 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Deleted volume successfully. Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-74410537-450a-4abe-adf9-85c0c60640de tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-ab2350c2-e88d-4dd0-98fc-331808fc2a6b-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:39 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c 1073741824" returned: 0 in 0.562s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:39 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c Sep 08 07:39:39 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:39 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c" returned: 0 in 0.336s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0a870c-ed42-4918-bed1-e2f27d7d4b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:39 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ca4070-94e1-4dc5-b6dd-a6bdfa521859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-6f0dd233-bf1b-4641-8e01-83b810c3a43a-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:40 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Volume volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c (fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c): created successfully Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ca4070-94e1-4dc5-b6dd-a6bdfa521859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Flow 'volume_create_manager' (ace416d9-e88e-4aaa-b8ce-a16b12dc4d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ca3f34d0-08d7-408c-8d25-a3c3205e16cb tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created volume successfully. Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-6f0dd233-bf1b-4641-8e01-83b810c3a43a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-quobyte-6f0dd233-bf1b-4641-8e01-83b810c3a43a" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-6f0dd233-bf1b-4641-8e01-83b810c3a43a" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a58cde-0540-490c-8e68-fc9f7b0051e0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:40 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a Sep 08 07:39:40 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:40 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a" returned: 0 in 0.388s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:40 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a Sep 08 07:39:40 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (6c6bf758-2901-44c2-9e70-daf439ed75e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:40 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886bf76e-c56e-4be5-8ced-f83d512647d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6f0dd233-bf1b-4641-8e01-83b810c3a43a" returned: 0 in 0.326s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-6f0dd233-bf1b-4641-8e01-83b810c3a43a" released by "delete_volume" :: held 0.778s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886bf76e-c56e-4be5-8ced-f83d512647d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1245329110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75995640-b573-4c45-8c17-319345df9f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:41Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7414b4a8-0a8e-42b8-9bab-51a0c8bb7799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7414b4a8-0a8e-42b8-9bab-51a0c8bb7799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14c3cce-ce75-49cf-be56-b96202b9dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14c3cce-ce75-49cf-be56-b96202b9dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75995640-b573-4c45-8c17-319345df9f6b', 'volume_name': 'volume-75995640-b573-4c45-8c17-319345df9f6b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a0b710-8f2e-407e-a63a-6f89c002512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a0b710-8f2e-407e-a63a-6f89c002512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a677e81-bfe2-4511-b9b0-c25aeeda3304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:40 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Volume 75995640-b573-4c45-8c17-319345df9f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75995640-b573-4c45-8c17-319345df9f6b', 'volume_size': 1} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1245329110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75995640-b573-4c45-8c17-319345df9f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:41Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Creating volume 75995640-b573-4c45-8c17-319345df9f6b {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:40 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:41 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b 1073741824 Sep 08 07:39:41 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-quobyte-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Created reservations ['11d965b9-6026-4147-b1ea-b2cfbe696ceb', '84bff2e8-5214-41ff-b8b3-420522a23626', '5963f825-07b7-4a02-bf85-59e69d3ceb0b', '43e0ae8a-b2f5-4f41-a283-e94786afb58a'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3ef723-1570-4080-9cd8-c7e32c5c9430]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:41 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:41 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:41 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c Sep 08 07:39:41 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:41 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b 1073741824" returned: 0 in 0.522s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:41 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.286s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Deleted volume successfully. Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-dc847111-a8fe-443a-9444-9332384b425c tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-6f0dd233-bf1b-4641-8e01-83b810c3a43a-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:41 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b Sep 08 07:39:41 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:41 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c" returned: 0 in 0.463s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:41 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c Sep 08 07:39:41 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:41 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b" returned: 0 in 0.296s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a677e81-bfe2-4511-b9b0-c25aeeda3304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75995640-b573-4c45-8c17-319345df9f6b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6b4a54-a24f-4c9b-92bd-dafa3fa5b873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:41 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Volume volume-75995640-b573-4c45-8c17-319345df9f6b (75995640-b573-4c45-8c17-319345df9f6b): created successfully Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6b4a54-a24f-4c9b-92bd-dafa3fa5b873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (6c6bf758-2901-44c2-9e70-daf439ed75e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:41 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bb192153-b629-4e5c-965b-b93708105dd1 tempest-ProjectMemberTests-1654685749 None] Created volume successfully. Sep 08 07:39:41 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c" returned: 0 in 0.344s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c" released by "delete_volume" :: held 0.857s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created reservations ['6c44c6f0-0816-4fb6-9ec8-357771d4f456', 'dd3f2181-3dfd-4a75-82d5-2c3253f5ac8b', '730eeffb-e0f9-4dba-bcea-93cfddff8723', 'e901f69b-73e9-45aa-9e8a-8434d0b5d76b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:42 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:42 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-adfe9c59-684d-4f6a-8392-adb90926040f-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-9aff11d3-46c2-4e28-902a-d09c036958c7-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-adfe9c59-684d-4f6a-8392-adb90926040f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-9aff11d3-46c2-4e28-902a-d09c036958c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-quobyte-7fba9f54-ef95-4a93-b890-00acac59b81d" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-quobyte-adfe9c59-684d-4f6a-8392-adb90926040f" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-7fba9f54-ef95-4a93-b890-00acac59b81d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-quobyte-9aff11d3-46c2-4e28-902a-d09c036958c7" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-9aff11d3-46c2-4e28-902a-d09c036958c7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Deleting offline snapshot 9aff11d3-46c2-4e28-902a-d09c036958c7 of volume 7fba9f54-ef95-4a93-b890-00acac59b81d {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] snapshot_file for this snap is: volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-adfe9c59-684d-4f6a-8392-adb90926040f" acquired by "delete_volume" :: waited 0.046s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec05c608-9c82-4bba-8bcf-e419b9bb977a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4869d5c1-2aa1-4b7d-8361-a2b9e8865661]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:42 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.395s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Deleted volume successfully. Sep 08 07:39:42 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 Sep 08 07:39:42 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0f62ae78-251f-433b-9c5a-d8a26a4a3b5e tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-fa9f90b3-0a1e-4276-96d5-fa2d45f43c7c-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:42 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f Sep 08 07:39:42 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:42 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7" returned: 0 in 0.428s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fba9f54-ef95-4a93-b890-00acac59b81d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:39:42 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f" returned: 0 in 0.445s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[02349b98-fbb6-4d79-b4ab-cc0a44e48121]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:42 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f Sep 08 07:39:42 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:43 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d Sep 08 07:39:43 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:43 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-adfe9c59-684d-4f6a-8392-adb90926040f" returned: 0 in 0.316s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-adfe9c59-684d-4f6a-8392-adb90926040f" released by "delete_volume" :: held 0.815s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created reservations ['253f0440-c4c7-4315-b694-6d5bb4ba00f5', '9dac4f7f-a5f2-468a-b544-c7680b335c2c', '1e9f2f3b-9de0-427e-a551-4586d392121e', '14d4e9ad-0bd4-4424-b51b-58bcfb0ff9e8'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:43 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:43 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:43 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d" returned: 0 in 0.539s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:43 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 Sep 08 07:39:43 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-ceadc780-d7a6-4534-bb13-92a9275e68c0-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-ceadc780-d7a6-4534-bb13-92a9275e68c0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-quobyte-ceadc780-d7a6-4534-bb13-92a9275e68c0" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Creating offline snapshot 76289250-f629-4ac1-ac7a-8d8b87fa7c69 of volume 75995640-b573-4c45-8c17-319345df9f6b {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-ceadc780-d7a6-4534-bb13-92a9275e68c0" acquired by "delete_volume" :: waited 0.035s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:43 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1ccc49-4da4-4143-98f7-d63f0d05388e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf27598-b610-4c37-874b-08562f89c4dc]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.407s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:43 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Deleted volume successfully. Sep 08 07:39:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-96fb1fab-81b4-412b-9be6-15c88b3e8044 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-adfe9c59-684d-4f6a-8392-adb90926040f-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:43 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b Sep 08 07:39:43 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:43 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 Sep 08 07:39:43 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:44 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7" returned: 0 in 0.611s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:44 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7 Sep 08 07:39:44 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:44 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0" returned: 0 in 0.472s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:44 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b" returned: 0 in 0.506s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:44 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0 Sep 08 07:39:44 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:44 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 1G Sep 08 07:39:44 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:44 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d.9aff11d3-46c2-4e28-902a-d09c036958c7" returned: 0 in 0.280s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-9aff11d3-46c2-4e28-902a-d09c036958c7" released by "_delete_snapshot" :: held 2.015s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-7fba9f54-ef95-4a93-b890-00acac59b81d" released by "delete_snapshot" :: held 2.044s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Created reservations ['3c409c42-d303-4f8f-8fcd-f7a667f9b143', 'f89a53a2-35c3-4a8d-b0f6-180811ddd41b', '1424985a-452e-446e-bc4d-23b291a92a48', 'f79a53d7-85f4-421d-8cea-51ec050527d9'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:44 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-ceadc780-d7a6-4534-bb13-92a9275e68c0" returned: 0 in 0.295s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-ceadc780-d7a6-4534-bb13-92a9275e68c0" released by "delete_volume" :: held 0.834s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:44 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Delete snapshot completed successfully. Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-2bdec22b-fd5e-4d77-b9cc-53afc04841df tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-9aff11d3-46c2-4e28-902a-d09c036958c7-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created reservations ['c1faa079-f809-414d-b983-9abdb8bd8f49', 'ad70bff7-e487-40a4-8286-7910c6260617', 'da3b07e8-9f53-4d64-aacb-69fdf2249b60', '80075f6d-fd01-45aa-8b25-19668a5fc658'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:44 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:44 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:44 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:44 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:44 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 1G" returned: 0 in 0.542s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75995640-b573-4c45-8c17-319345df9f6b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:44 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75995640-b573-4c45-8c17-319345df9f6b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 Sep 08 07:39:44 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-c9cae85e-c1b8-48e8-909f-228dff0326be-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-c9cae85e-c1b8-48e8-909f-228dff0326be-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-quobyte-c9cae85e-c1b8-48e8-909f-228dff0326be" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-c9cae85e-c1b8-48e8-909f-228dff0326be" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9859612c-f48c-48c7-8eb8-d4e578d85e62]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:45 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.378s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:39:45 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.353s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Deleted volume successfully. Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22a1a6d4-6fc6-426f-b0dc-1c9cd8d0ed69 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-ceadc780-d7a6-4534-bb13-92a9275e68c0-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:45 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be Sep 08 07:39:45 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:45 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75995640-b573-4c45-8c17-319345df9f6b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69" returned: 0 in 0.410s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:45 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 is being set with open permissions: ugo+rw Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:45 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 Sep 08 07:39:45 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:45 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69" returned: 0 in 0.256s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:45 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be" returned: 0 in 0.444s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:45 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be Sep 08 07:39:45 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:45 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.info Sep 08 07:39:45 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-7fba9f54-ef95-4a93-b890-00acac59b81d-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-7fba9f54-ef95-4a93-b890-00acac59b81d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "cinder-quobyte-7fba9f54-ef95-4a93-b890-00acac59b81d" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-7fba9f54-ef95-4a93-b890-00acac59b81d" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[83953af3-4cf8-459d-a9ac-2e2e83819108]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:45 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c9cae85e-c1b8-48e8-909f-228dff0326be" returned: 0 in 0.334s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-c9cae85e-c1b8-48e8-909f-228dff0326be" released by "delete_volume" :: held 0.859s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:45 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created reservations ['9775ff93-6507-49b7-8f26-f3aadcf67def', '34fed247-7c92-48f4-a54a-a7f4f42f4c13', '1f392587-319c-4bb9-8456-91d1ec37f780', 'bd3f272a-f3d4-4d7e-8c3d-91e50b259efb'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.info" returned: 0 in 0.367s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:45 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.info is being set with open permissions: ugo+rw Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:45 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d Sep 08 07:39:45 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:45 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.info Sep 08 07:39:45 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:46 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:46 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:46 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.info" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:46 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d" returned: 0 in 0.513s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-quobyte-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:46 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4b146daf-fd12-418a-bafc-afc109f06575 tempest-ProjectMemberTests-1654685749 None] Create snapshot completed successfully Sep 08 07:39:46 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d Sep 08 07:39:46 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4" acquired by "delete_volume" :: waited 0.029s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2878ce66-8e9c-4e8a-9ff6-b687a0fab0ac]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:46 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.382s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:46 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Deleted volume successfully. Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2bf9600-620a-46d1-a909-3585f2e1ccd0 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-c9cae85e-c1b8-48e8-909f-228dff0326be-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:46 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 Sep 08 07:39:46 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:46 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7fba9f54-ef95-4a93-b890-00acac59b81d" returned: 0 in 0.296s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-quobyte-7fba9f54-ef95-4a93-b890-00acac59b81d" released by "delete_volume" :: held 0.886s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Created reservations ['5cdfb197-71b0-4c6d-b845-a3809635e666', '13ef2534-3027-4ad5-b325-2fe4cef38d2f', '040a600a-cf33-4099-b62b-001f08ff09c9', '85b68b74-8824-4b95-a247-a85bd43457f9'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-76289250-f629-4ac1-ac7a-8d8b87fa7c69-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:46 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:46 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:46 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Lock "cinder-76289250-f629-4ac1-ac7a-8d8b87fa7c69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-75995640-b573-4c45-8c17-319345df9f6b" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4" returned: 0 in 0.502s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-75995640-b573-4c45-8c17-319345df9f6b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-76289250-f629-4ac1-ac7a-8d8b87fa7c69" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:46 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4 Sep 08 07:39:46 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-76289250-f629-4ac1-ac7a-8d8b87fa7c69" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Deleting offline snapshot 76289250-f629-4ac1-ac7a-8d8b87fa7c69 of volume 75995640-b573-4c45-8c17-319345df9f6b {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] snapshot_file for this snap is: volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd1d9ab-44a6-4df9-b436-e1b8404548e1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:47 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 Sep 08 07:39:47 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:47 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.272s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Deleted volume successfully. Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4fd31fff-678f-49ab-aaa1-e8da204385ee tempest-CreateVolumesFromSnapshotTest-523906847 None] Lock "cinder-7fba9f54-ef95-4a93-b890-00acac59b81d-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:47 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4" returned: 0 in 0.293s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4" released by "delete_volume" :: held 0.841s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created reservations ['0d0be879-16a4-4ed4-b122-d40a4d4b1f71', '3042ec41-c05b-4fd5-84ba-56d75bc40663', '2ee97da0-b52a-4b47-979c-8e2bda978a91', 'aeee6603-071e-43a9-9794-16027f629c11'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:47 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:47 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:47 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-01194f20-fb37-437f-8834-4b5eeb377d81-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69" returned: 0 in 0.405s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75995640-b573-4c45-8c17-319345df9f6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-01194f20-fb37-437f-8834-4b5eeb377d81-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8da1f4-5b5f-47c2-8475-b9bf82ffb70c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "cinder-quobyte-01194f20-fb37-437f-8834-4b5eeb377d81" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-01194f20-fb37-437f-8834-4b5eeb377d81" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fbccec-1042-4d1d-bf91-24f5f3297189]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:47 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b Sep 08 07:39:47 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:47 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.290s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Deleted volume successfully. Sep 08 07:39:47 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81 Sep 08 07:39:47 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-3ee7ae98-85b6-4bc6-8fe0-9f466001f952 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-3c1f8806-ae5a-4e33-9c03-e56f0b8a86b4-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:47 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b" returned: 0 in 0.402s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:47 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 Sep 08 07:39:47 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:47 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81" returned: 0 in 0.459s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:47 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81 Sep 08 07:39:47 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:48 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69" returned: 0 in 0.435s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:48 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69 Sep 08 07:39:48 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:48 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-01194f20-fb37-437f-8834-4b5eeb377d81" returned: 0 in 0.334s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-quobyte-01194f20-fb37-437f-8834-4b5eeb377d81" released by "delete_volume" :: held 0.848s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Created reservations ['2d712b95-1abe-43f0-8641-7ee65cc87294', 'e7b77d0e-caa8-4113-a3f9-fab7048af4d8', 'b8d7d1da-49af-4cae-a28e-bc8f7b1d877d', '7af932aa-628a-4c99-9389-abcd0f531a7b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:48 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:48 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:48 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b.76289250-f629-4ac1-ac7a-8d8b87fa7c69" returned: 0 in 0.372s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-76289250-f629-4ac1-ac7a-8d8b87fa7c69" released by "_delete_snapshot" :: held 1.774s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-75995640-b573-4c45-8c17-319345df9f6b" released by "delete_snapshot" :: held 1.805s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Created reservations ['9d188928-d6c0-4b0c-aac0-e5125b8db5f1', '0226db4c-ec8b-45cd-b092-2dd06394cfd1', '60329da5-01ff-46bf-87b1-69b9a4995202', '6862325c-a18e-4124-8c7c-10370ea28835'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:48 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Delete snapshot completed successfully. Sep 08 07:39:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ff7ee4c7-d1a4-4aec-a08c-6d217a7adc3d tempest-ProjectMemberTests-1654685749 None] Lock "cinder-76289250-f629-4ac1-ac7a-8d8b87fa7c69-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:49 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.542s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:49 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Deleted volume successfully. Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0543fcd6-2054-4484-a89f-2fc0dc1e93c1 tempest-CreateVolumesFromSourceVolumeTest-1479891448 None] Lock "cinder-01194f20-fb37-437f-8834-4b5eeb377d81-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-75995640-b573-4c45-8c17-319345df9f6b-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-75995640-b573-4c45-8c17-319345df9f6b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-75995640-b573-4c45-8c17-319345df9f6b" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-75995640-b573-4c45-8c17-319345df9f6b" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f85858-f972-4705-9432-99d1479b51c4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:49 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b Sep 08 07:39:49 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:49 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b" returned: 0 in 0.419s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:49 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b Sep 08 07:39:49 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:50 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-75995640-b573-4c45-8c17-319345df9f6b" returned: 0 in 0.291s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-75995640-b573-4c45-8c17-319345df9f6b" released by "delete_volume" :: held 0.797s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Created reservations ['e221ba1b-66f8-44d0-b957-506e234d4c01', 'a47b39d3-debb-4414-8743-d2382d5e6a6e', '15dad59f-5670-42f8-ae52-907807598dfd', '64a65440-f109-481b-90e5-c1f5c349e5ad'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:50 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:50 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:50 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.373s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:50 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Deleted volume successfully. Sep 08 07:39:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-bedbd028-3a20-4351-b522-49add027b298 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-75995640-b573-4c45-8c17-319345df9f6b-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (1f65a657-4774-42a1-b589-22da136016c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0141c993-5365-4108-a952-7b227966e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0141c993-5365-4108-a952-7b227966e175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1967078744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d7518a-382a-4b80-8289-7fe29fd82792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:51Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (807bce7f-4c13-4a2b-be7b-26dd357d35d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (807bce7f-4c13-4a2b-be7b-26dd357d35d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5d96ed-667c-4c53-b998-0bf2c7c50974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5d96ed-667c-4c53-b998-0bf2c7c50974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d7518a-382a-4b80-8289-7fe29fd82792', 'volume_name': 'volume-e8d7518a-382a-4b80-8289-7fe29fd82792', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b947b4-eb83-4b1f-bcbd-3fc7bec3ec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b947b4-eb83-4b1f-bcbd-3fc7bec3ec36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830ae6b8-72d3-4eda-bb2b-a6ca45414c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:51 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Volume e8d7518a-382a-4b80-8289-7fe29fd82792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d7518a-382a-4b80-8289-7fe29fd82792', 'volume_size': 1} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1967078744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d7518a-382a-4b80-8289-7fe29fd82792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:51Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Creating volume e8d7518a-382a-4b80-8289-7fe29fd82792 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:51 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:51 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 1073741824 Sep 08 07:39:51 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:51 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 1073741824" returned: 0 in 0.518s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:51 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 Sep 08 07:39:51 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:51 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792" returned: 0 in 0.309s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830ae6b8-72d3-4eda-bb2b-a6ca45414c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d7518a-382a-4b80-8289-7fe29fd82792', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a412f18-7393-4c31-b439-b6ef14c360d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:52 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Volume volume-e8d7518a-382a-4b80-8289-7fe29fd82792 (e8d7518a-382a-4b80-8289-7fe29fd82792): created successfully Sep 08 07:39:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a412f18-7393-4c31-b439-b6ef14c360d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (1f65a657-4774-42a1-b589-22da136016c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:52 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3621641c-cb9a-41b9-ba33-156badb23626 tempest-ProjectMemberTests-1654685749 None] Created volume successfully. Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Flow 'volume_create_manager' (8375d4f6-4789-4bcd-84e1-8cacb02da7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bdf1ca-d717-470c-8ad9-01280bb1b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Creating offline snapshot fbb87ee6-440d-41e6-9b91-42b6ed555022 of volume e8d7518a-382a-4b80-8289-7fe29fd82792 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bdf1ca-d717-470c-8ad9-01280bb1b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1157029278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188b679d-0aa3-4fb6-bcf7-1bdb036b99ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70552c5ef5d54a8b9c54e0bb7ae9f55e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:53Z,use_quota=True,user_id='a86d3509fb2341cbb5bf51910bc1f375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c88b32d-df97-48a8-9a30-c67429e5ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c88b32d-df97-48a8-9a30-c67429e5ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed3d55e-342e-4f4b-a74a-67de8fe7aa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed3d55e-342e-4f4b-a74a-67de8fe7aa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188b679d-0aa3-4fb6-bcf7-1bdb036b99ff', 'volume_name': 'volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf7e882-8c3a-4c65-9de0-dfc528baeafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf7e882-8c3a-4c65-9de0-dfc528baeafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa94fb7f-2379-456e-8800-9ba668563bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:53 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Volume 188b679d-0aa3-4fb6-bcf7-1bdb036b99ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff', 'volume_size': 1} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a12d9ff-1e9b-47d2-b7d5-5d2cfd9a57b1]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:53 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 Sep 08 07:39:53 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:53 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:54 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 1G Sep 08 07:39:54 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:54 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 1G" returned: 0 in 0.530s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8d7518a-382a-4b80-8289-7fe29fd82792 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:54 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8d7518a-382a-4b80-8289-7fe29fd82792 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 Sep 08 07:39:54 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:54 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8d7518a-382a-4b80-8289-7fe29fd82792 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022" returned: 0 in 0.365s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:54 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 is being set with open permissions: ugo+rw Sep 08 07:39:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:54 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 Sep 08 07:39:54 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Flow 'volume_create_manager' (b431904e-194e-4f28-825a-ad2f4bfc56dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a60206f-ee10-423f-8829-dd191e80d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a60206f-ee10-423f-8829-dd191e80d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14b0cea-f32e-42b0-ac13-3665cfe7a889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f302d2d31e14ef5b5607df5fb8af221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:55Z,use_quota=True,user_id='6400011bca264cbd927462329df2f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348d3321-2847-41c2-bb1b-152f1635f6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348d3321-2847-41c2-bb1b-152f1635f6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe33d337-0ca6-4689-b192-4b3df8fc2d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.image.glance [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Creating Keystone auth plugin from conf {{(pid=87278) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:39:55 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022" returned: 0 in 0.274s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:55 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.info Sep 08 07:39:55 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:55 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.info" returned: 0 in 0.289s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:55 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.info is being set with open permissions: ugo+rw Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:55 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.info Sep 08 07:39:55 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe33d337-0ca6-4689-b192-4b3df8fc2d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e14b0cea-f32e-42b0-ac13-3665cfe7a889', 'volume_name': 'volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889', 'volume_size': 1, 'image_id': 'da607b7c-fcab-4770-8c6a-057b92ff14f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da607b7c-fcab-4770-8c6a-057b92ff14f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e0acbced0fd9ea23a2c351fa4456475', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f302d2d31e14ef5b5607df5fb8af221', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fca68bb82fbf16067e384f7dee1380f25c42eb2b0392ef5326c4d4f647a71b929fabebfd39c0870a142abd916bbe77ec06519057d30f4789e2ab83ef6d420c3', 'id': 'da607b7c-fcab-4770-8c6a-057b92ff14f0', 'created_at': datetime.datetime(2026, 9, 8, 5, 39, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 39, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da607b7c-fcab-4770-8c6a-057b92ff14f0/file', 'properties': {}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70d5464-4d5d-43fa-9e00-93640780b972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70d5464-4d5d-43fa-9e00-93640780b972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247f96cb-fcce-4b61-8ce3-b5592dd904fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Volume e14b0cea-f32e-42b0-ac13-3665cfe7a889: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889', 'volume_size': 1, 'image_id': 'da607b7c-fcab-4770-8c6a-057b92ff14f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da607b7c-fcab-4770-8c6a-057b92ff14f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e0acbced0fd9ea23a2c351fa4456475', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f302d2d31e14ef5b5607df5fb8af221', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fca68bb82fbf16067e384f7dee1380f25c42eb2b0392ef5326c4d4f647a71b929fabebfd39c0870a142abd916bbe77ec06519057d30f4789e2ab83ef6d420c3', 'id': 'da607b7c-fcab-4770-8c6a-057b92ff14f0', 'created_at': datetime.datetime(2026, 9, 8, 5, 39, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 39, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da607b7c-fcab-4770-8c6a-057b92ff14f0/file', 'properties': {}}, 'image_service': } Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Trying to clone e14b0cea-f32e-42b0-ac13-3665cfe7a889 from image da607b7c-fcab-4770-8c6a-057b92ff14f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/da607b7c-fcab-4770-8c6a-057b92ff14f0', 'metadata': {}}]). {{(pid=87278) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:39:55 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Image download 0.00 MB at 0.00 MB/s Sep 08 07:39:55 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[76df1a4c-4140-4ab6-b636-e5c3596c0f28]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.info" returned: 0 in 0.312s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.252s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1157029278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188b679d-0aa3-4fb6-bcf7-1bdb036b99ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70552c5ef5d54a8b9c54e0bb7ae9f55e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:53Z,use_quota=True,user_id='a86d3509fb2341cbb5bf51910bc1f375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Creating volume 188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:55 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:55 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff 1073741824 Sep 08 07:39:55 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Flow 'volume_create_manager' (30ac2789-0fd3-48a9-b473-81b02e780624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e96ddf-7ad2-492c-a469-eafcbe92213e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD Sep 08 07:39:55 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e96ddf-7ad2-492c-a469-eafcbe92213e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-458190397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1c3645-4ba7-43ad-a3e9-dc1b1fded522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4291cfec16d847c1888683dd2ee6011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:56Z,use_quota=True,user_id='db3c003673ef4787965d313113513448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6003ff-d6bb-48bb-b806-714450dc48c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6003ff-d6bb-48bb-b806-714450dc48c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41fc859-dd69-45db-9e00-9870a96642a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41fc859-dd69-45db-9e00-9870a96642a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1c3645-4ba7-43ad-a3e9-dc1b1fded522', 'volume_name': 'volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a146ff60-44d1-4f7f-b422-34b462bf73ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a146ff60-44d1-4f7f-b422-34b462bf73ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112da679-c25c-4adf-9205-d87b4f66af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:55 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Volume 6e1c3645-4ba7-43ad-a3e9-dc1b1fded522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522', 'volume_size': 1} Sep 08 07:39:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:55 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-78d8d55e-f27e-4ea7-9419-d0f24d4c0827 tempest-ProjectMemberTests-1654685749 None] Create snapshot completed successfully Sep 08 07:39:56 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:56 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff 1073741824" returned: 0 in 0.411s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:56 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD Sep 08 07:39:56 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:56 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff Sep 08 07:39:56 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:56 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Temporary image da607b7c-fcab-4770-8c6a-057b92ff14f0 is fetched for user 6400011bca264cbd927462329df2f63e. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:39:56 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-fbb87ee6-440d-41e6-9b91-42b6ed555022-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" returned: 0 in 0.266s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-458190397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1c3645-4ba7-43ad-a3e9-dc1b1fded522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4291cfec16d847c1888683dd2ee6011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:56Z,use_quota=True,user_id='db3c003673ef4787965d313113513448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Creating volume 6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:56 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-fbb87ee6-440d-41e6-9b91-42b6ed555022-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-e8d7518a-382a-4b80-8289-7fe29fd82792" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:56 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 1073741824 Sep 08 07:39:56 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa94fb7f-2379-456e-8800-9ba668563bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78116ad-a67c-474f-89b8-f76a0b449969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-e8d7518a-382a-4b80-8289-7fe29fd82792" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-fbb87ee6-440d-41e6-9b91-42b6ed555022" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:56 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Volume volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff (188b679d-0aa3-4fb6-bcf7-1bdb036b99ff): created successfully Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78116ad-a67c-474f-89b8-f76a0b449969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Flow 'volume_create_manager' (8375d4f6-4789-4bcd-84e1-8cacb02da7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c14d0ed-9b86-4506-a1a0-96f2802e2a47]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-fbb87ee6-440d-41e6-9b91-42b6ed555022" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Deleting offline snapshot fbb87ee6-440d-41e6-9b91-42b6ed555022 of volume e8d7518a-382a-4b80-8289-7fe29fd82792 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] snapshot_file for this snap is: volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:39:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-341aa837-4ae9-4f92-ae8f-c4fa081753bc tempest-VolumeDependencyTests-807358281 None] Created volume successfully. Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aa9d72-289c-4829-8b35-342608cb4237]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:56 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD Sep 08 07:39:56 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:56 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 Sep 08 07:39:56 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:57 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 1073741824" returned: 0 in 0.437s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:57 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:57 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 Sep 08 07:39:57 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:57 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022" returned: 0 in 0.414s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8d7518a-382a-4b80-8289-7fe29fd82792(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:39:57 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac22413-f60e-45f1-9a72-64ad105836ea]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:57 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:57 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 Sep 08 07:39:57 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:57 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522" returned: 0 in 0.281s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112da679-c25c-4adf-9205-d87b4f66af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14477b5-88cf-4f02-830a-d75083166121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:57 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Volume volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 (6e1c3645-4ba7-43ad-a3e9-dc1b1fded522): created successfully Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14477b5-88cf-4f02-830a-d75083166121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Flow 'volume_create_manager' (30ac2789-0fd3-48a9-b473-81b02e780624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:57 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14b0cea-f32e-42b0-ac13-3665cfe7a889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f302d2d31e14ef5b5607df5fb8af221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:39:55Z,use_quota=True,user_id='6400011bca264cbd927462329df2f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Creating volume e14b0cea-f32e-42b0-ac13-3665cfe7a889 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:39:57 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:57 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-965440a7-c3c3-456b-977c-ef4cf0c84e6d tempest-ProjectReaderTests-2012143800 None] Created volume successfully. Sep 08 07:39:57 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 1073741824 Sep 08 07:39:57 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:57 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792" returned: 0 in 0.402s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:57 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 Sep 08 07:39:57 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:57 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 1073741824" returned: 0 in 0.521s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:58 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022" returned: 0 in 0.418s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:58 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 Sep 08 07:39:58 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:58 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022 Sep 08 07:39:58 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Acquiring lock "cinder-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Lock "cinder-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Acquiring lock "cinder-quobyte-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Lock "cinder-quobyte-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cace16-9481-4afe-bbab-0d245f06e2f7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:58 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792.fbb87ee6-440d-41e6-9b91-42b6ed555022" returned: 0 in 0.283s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:58 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889" returned: 0 in 0.318s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.485s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:58 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 Sep 08 07:39:58 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-fbb87ee6-440d-41e6-9b91-42b6ed555022" released by "_delete_snapshot" :: held 1.699s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Creating offline snapshot 9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 of volume 188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-e8d7518a-382a-4b80-8289-7fe29fd82792" released by "delete_snapshot" :: held 1.772s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Attempting download of da607b7c-fcab-4770-8c6a-057b92ff14f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/da607b7c-fcab-4770-8c6a-057b92ff14f0', 'metadata': {}}])) to volume e14b0cea-f32e-42b0-ac13-3665cfe7a889. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[323ca2eb-2847-43d8-9043-3f4e0f2f2b91]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f813bd-5762-4d27-8ca4-477a88eceefa]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da607b7c-fcab-4770-8c6a-057b92ff14f0_ek04f9qv {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Created reservations ['e4a4a0ad-e0bf-408d-804b-cd022bbae533', '2b173b49-b679-43f7-ae45-027fffc444b0', '84c320ae-1872-4456-bd3a-f3d191c98777', '151d0942-7ba6-4360-adfe-e92f3a0001ea'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:58 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff Sep 08 07:39:58 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:58 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Delete snapshot completed successfully. Sep 08 07:39:58 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da607b7c-fcab-4770-8c6a-057b92ff14f0_ek04f9qv Sep 08 07:39:58 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c56b0191-3ae8-48db-9831-acbc06040f36 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-fbb87ee6-440d-41e6-9b91-42b6ed555022-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:58 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522" returned: 0 in 0.444s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:58 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522 Sep 08 07:39:58 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-e8d7518a-382a-4b80-8289-7fe29fd82792-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-e8d7518a-382a-4b80-8289-7fe29fd82792-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-e8d7518a-382a-4b80-8289-7fe29fd82792" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-e8d7518a-382a-4b80-8289-7fe29fd82792" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:39:58 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:58 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da607b7c-fcab-4770-8c6a-057b92ff14f0_ek04f9qv" returned: 0 in 0.459s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" returned: 0 in 0.513s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da607b7c-fcab-4770-8c6a-057b92ff14f0_ek04f9qv {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5e8d52-c60c-4523-ac5e-f6e43594c08d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:58 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 1G Sep 08 07:39:58 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:59 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522" returned: 0 in 0.347s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Lock "cinder-quobyte-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522" released by "delete_volume" :: held 0.843s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:59 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da607b7c-fcab-4770-8c6a-057b92ff14f0_ek04f9qv Sep 08 07:39:59 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:59 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 Sep 08 07:39:59 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Created reservations ['53968abc-c90d-4aa3-b7fb-3ce6e1286798', '1c863956-7307-4c1b-bf9b-ef5a1fc99342', '90efc980-e44b-4e68-ab3d-d0dc85fc0efe', '8b50eb3f-25fc-4c26-82aa-4fc38b79f259'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:59 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:39:59 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:59 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da607b7c-fcab-4770-8c6a-057b92ff14f0_ek04f9qv" returned: 1 in 0.428s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da607b7c-fcab-4770-8c6a-057b92ff14f0_ek04f9qv' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5591ccc6-68d1-494d-b816-038c4896211d]: (4, 'raw') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:59 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792" returned: 0 in 0.491s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:59 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 1G" returned: 0 in 0.554s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:59 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792 Sep 08 07:39:59 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:59 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 Sep 08 07:39:59 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:59 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD Sep 08 07:39:59 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:39:59 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.387s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:39:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Deleted volume successfully. Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5745ad3e-47e4-49d5-94dd-eff8c530ce7f tempest-ProjectReaderTests-2012143800 None] Lock "cinder-6e1c3645-4ba7-43ad-a3e9-dc1b1fded522-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:59 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Flow 'volume_create_manager' (d2b8e5fd-b6d3-425e-95e1-fd68960422eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113e9630-a418-4484-bb1d-7cf0158efebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e8d7518a-382a-4b80-8289-7fe29fd82792" returned: 0 in 0.433s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:59 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-e8d7518a-382a-4b80-8289-7fe29fd82792" released by "delete_volume" :: held 1.019s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:39:59 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113e9630-a418-4484-bb1d-7cf0158efebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258504450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf61686-841e-423e-b6ac-a5610a5a17f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4291cfec16d847c1888683dd2ee6011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:00Z,use_quota=True,user_id='db3c003673ef4787965d313113513448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe727e8d-beba-4067-a75e-e5ccfea07448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe727e8d-beba-4067-a75e-e5ccfea07448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87da0b05-bd9a-4463-9e5b-45693a2872f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87da0b05-bd9a-4463-9e5b-45693a2872f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf61686-841e-423e-b6ac-a5610a5a17f7', 'volume_name': 'volume-dcf61686-841e-423e-b6ac-a5610a5a17f7', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28960673-93a1-4c9b-80d7-a8b41cbd0843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:39:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28960673-93a1-4c9b-80d7-a8b41cbd0843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549266fe-cd98-4529-9db7-1dc0d353b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:00 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Volume dcf61686-841e-423e-b6ac-a5610a5a17f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf61686-841e-423e-b6ac-a5610a5a17f7', 'volume_size': 1} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9" returned: 0 in 0.496s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:00 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 is being set with open permissions: ugo+rw Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:00 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 Sep 08 07:40:00 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Created reservations ['83e752bc-2701-43a6-b27b-2728c90dec46', '23f80642-18ce-43ec-98a4-a1363e4e0cdf', 'b1c8f703-cfc1-4080-a1cb-5042bbe8415b', '3076afe7-ccc1-4f3b-9d27-ecdbc3d77dd0'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:00 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD Sep 08 07:40:00 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:00 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:00 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:00 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9" returned: 0 in 0.256s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:00 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] da607b7c-fcab-4770-8c6a-057b92ff14f0 was raw, converting to qcow2 {{(pid=87278) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:00 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.info Sep 08 07:40:00 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:00 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 Sep 08 07:40:00 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:00 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.266s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:00 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Deleted volume successfully. Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2b5c7d-82b1-4643-8ce9-577c99545ce4 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-e8d7518a-382a-4b80-8289-7fe29fd82792-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:00 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.info" returned: 0 in 0.280s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:00 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.info is being set with open permissions: ugo+rw Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:00 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.info Sep 08 07:40:00 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:00 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889" returned: 0 in 0.445s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_da607b7c-fcab-4770-8c6a-057b92ff14f0_af29j9txdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:40:00 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:00 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 1G Sep 08 07:40:00 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:00 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.info" returned: 0 in 0.248s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258504450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf61686-841e-423e-b6ac-a5610a5a17f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4291cfec16d847c1888683dd2ee6011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:00Z,use_quota=True,user_id='db3c003673ef4787965d313113513448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Creating volume dcf61686-841e-423e-b6ac-a5610a5a17f7 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:00 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:00 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 1073741824 Sep 08 07:40:00 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:00 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5fd6dc56-abb1-4260-bacd-70e5462d6303 tempest-VolumeDependencyTests-807358281 None] Create snapshot completed successfully Sep 08 07:40:01 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 1G" returned: 0 in 0.382s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Downloaded image da607b7c-fcab-4770-8c6a-057b92ff14f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/da607b7c-fcab-4770-8c6a-057b92ff14f0', 'metadata': {}}])) to volume e14b0cea-f32e-42b0-ac13-3665cfe7a889 successfully. {{(pid=87278) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Temporary image da607b7c-fcab-4770-8c6a-057b92ff14f0 for user 6400011bca264cbd927462329df2f63e is deleted. {{(pid=87278) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.volume_utils [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Marking volume e14b0cea-f32e-42b0-ac13-3665cfe7a889 as bootable. {{(pid=87278) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Copying metadata from image da607b7c-fcab-4770-8c6a-057b92ff14f0 to e14b0cea-f32e-42b0-ac13-3665cfe7a889. {{(pid=87278) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Creating volume glance metadata for volume e14b0cea-f32e-42b0-ac13-3665cfe7a889 backed by image da607b7c-fcab-4770-8c6a-057b92ff14f0 with: {'image_id': 'da607b7c-fcab-4770-8c6a-057b92ff14f0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2e0acbced0fd9ea23a2c351fa4456475', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87278) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247f96cb-fcce-4b61-8ce3-b5592dd904fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889', 'volume_size': 1, 'image_id': 'da607b7c-fcab-4770-8c6a-057b92ff14f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da607b7c-fcab-4770-8c6a-057b92ff14f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e0acbced0fd9ea23a2c351fa4456475', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f302d2d31e14ef5b5607df5fb8af221', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fca68bb82fbf16067e384f7dee1380f25c42eb2b0392ef5326c4d4f647a71b929fabebfd39c0870a142abd916bbe77ec06519057d30f4789e2ab83ef6d420c3', 'id': 'da607b7c-fcab-4770-8c6a-057b92ff14f0', 'created_at': datetime.datetime(2026, 9, 8, 5, 39, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 39, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da607b7c-fcab-4770-8c6a-057b92ff14f0/file', 'properties': {}}, 'image_service': }' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcbae3e-8e96-4db3-bc0f-89f972d5438d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:01 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Volume volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 (e14b0cea-f32e-42b0-ac13-3665cfe7a889): created successfully Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcbae3e-8e96-4db3-bc0f-89f972d5438d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Flow 'volume_create_manager' (b431904e-194e-4f28-825a-ad2f4bfc56dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ed81d1fc-8ce7-4164-a14a-630275838809 tempest-VolumeImageDependencyTests-904582376 None] Created volume successfully. Sep 08 07:40:01 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 1073741824" returned: 0 in 0.541s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:01 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 Sep 08 07:40:01 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Acquiring lock "cinder-e14b0cea-f32e-42b0-ac13-3665cfe7a889-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Lock "cinder-e14b0cea-f32e-42b0-ac13-3665cfe7a889-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Acquiring lock "cinder-quobyte-e14b0cea-f32e-42b0-ac13-3665cfe7a889" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:01 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Lock "cinder-quobyte-e14b0cea-f32e-42b0-ac13-3665cfe7a889" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7" returned: 0 in 0.301s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549266fe-cd98-4529-9db7-1dc0d353b47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf61686-841e-423e-b6ac-a5610a5a17f7', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5835a2a-fa7c-4e03-9184-25e2acdbd78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3519f3-e9af-4eda-99d3-a2e1e4b89e86]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:01 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Volume volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 (dcf61686-841e-423e-b6ac-a5610a5a17f7): created successfully Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5835a2a-fa7c-4e03-9184-25e2acdbd78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Flow 'volume_create_manager' (d2b8e5fd-b6d3-425e-95e1-fd68960422eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-01622d9a-d355-45ab-bb96-966724e6d8a3 tempest-ProjectReaderTests-2012143800 None] Created volume successfully. Sep 08 07:40:01 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 Sep 08 07:40:01 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (817b6f1e-3b72-42e0-8bb0-bc183673e1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4089f7-596c-45a7-a7d2-ab838f14b77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:01 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Flow 'volume_create_manager' (c56fac2e-23ea-402d-b058-c4291129af85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc9f1ed-2e55-41be-bb03-b74102601b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4089f7-596c-45a7-a7d2-ab838f14b77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17110923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a131df2-ffb1-4fc7-9efc-43e6545d7843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:02Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3855550c-e5e4-47b8-8edc-798aa68720e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3855550c-e5e4-47b8-8edc-798aa68720e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfab67f3-c9d7-4949-80e1-42b553a1632d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfab67f3-c9d7-4949-80e1-42b553a1632d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a131df2-ffb1-4fc7-9efc-43e6545d7843', 'volume_name': 'volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238556ae-3064-40cd-ac56-052ae7394086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238556ae-3064-40cd-ac56-052ae7394086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c53425-84ac-4a6e-83b2-8c0081fc7164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Volume 4a131df2-ffb1-4fc7-9efc-43e6545d7843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843', 'volume_size': 1} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17110923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a131df2-ffb1-4fc7-9efc-43e6545d7843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:02Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Creating volume 4a131df2-ffb1-4fc7-9efc-43e6545d7843 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:02 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc9f1ed-2e55-41be-bb03-b74102601b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1064448479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b8e154-5b85-4867-8bb9-b2c597fa3423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70552c5ef5d54a8b9c54e0bb7ae9f55e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e86e4d8-fa61-4e4f-ae3c-17755332c3d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:02Z,use_quota=True,user_id='a86d3509fb2341cbb5bf51910bc1f375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 1073741824 Sep 08 07:40:02 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8925d86-0036-443e-9ce1-e1795940af72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8925d86-0036-443e-9ce1-e1795940af72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138e93f5-25c8-4323-90bf-b239a23a4f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138e93f5-25c8-4323-90bf-b239a23a4f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6b8e154-5b85-4867-8bb9-b2c597fa3423', 'volume_name': 'volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423', 'volume_size': 1, 'snapshot_id': '9e86e4d8-fa61-4e4f-ae3c-17755332c3d9'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff38c3e5-53b1-4c79-8d62-d434235c4e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff38c3e5-53b1-4c79-8d62-d434235c4e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa418002-8e33-4d3c-9e8c-5651da6748ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Volume f6b8e154-5b85-4867-8bb9-b2c597fa3423: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423', 'volume_size': 1, 'snapshot_id': '9e86e4d8-fa61-4e4f-ae3c-17755332c3d9'} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:02 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889" returned: 0 in 0.385s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:02 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889 Sep 08 07:40:02 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:02 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-e14b0cea-f32e-42b0-ac13-3665cfe7a889" returned: 0 in 0.250s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Lock "cinder-quobyte-e14b0cea-f32e-42b0-ac13-3665cfe7a889" released by "delete_volume" :: held 0.696s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Created reservations ['fae5b8a0-66b8-49ad-9499-665281f57445', 'bf5af187-aca5-43eb-b21b-e5f339f92443', '8e429d6d-9d6a-4d82-aaad-0a50bb07b89d', '4a6f11d2-30f7-4231-855a-e2329a006def'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:02 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 1073741824" returned: 0 in 0.427s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:02 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 Sep 08 07:40:02 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:02 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:02 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:02 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843" returned: 0 in 0.268s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.681s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "cinder-quobyte-9e86e4d8-fa61-4e4f-ae3c-17755332c3d9-f6b8e154-5b85-4867-8bb9-b2c597fa3423" by "_create_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c53425-84ac-4a6e-83b2-8c0081fc7164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d85b5e-49ef-4d15-af4e-f8691d08f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-9e86e4d8-fa61-4e4f-ae3c-17755332c3d9-f6b8e154-5b85-4867-8bb9-b2c597fa3423" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Creating volume f6b8e154-5b85-4867-8bb9-b2c597fa3423 from snapshot 9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 {{(pid=87278) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "cinder-quobyte-f6b8e154-5b85-4867-8bb9-b2c597fa3423" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:02 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-f6b8e154-5b85-4867-8bb9-b2c597fa3423" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] snapshot: 9e86e4d8-fa61-4e4f-ae3c-17755332c3d9, volume: f6b8e154-5b85-4867-8bb9-b2c597fa3423, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:40:02 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Volume volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 (4a131df2-ffb1-4fc7-9efc-43e6545d7843): created successfully Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d85b5e-49ef-4d15-af4e-f8691d08f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (817b6f1e-3b72-42e0-8bb0-bc183673e1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.339s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:02 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:03 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Deleted volume successfully. Sep 08 07:40:03 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7f9d1b33-df30-4c2b-b3dd-ffeba21cb0c8 tempest-ProjectMemberTests-1654685749 None] Created volume successfully. Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c53353d-9132-4648-9734-5d578a240003]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Acquiring lock "cinder-dcf61686-841e-423e-b6ac-a5610a5a17f7-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5615ca3-7816-406d-b532-7e568dca2d4f tempest-VolumeImageDependencyTests-904582376 None] Lock "cinder-e14b0cea-f32e-42b0-ac13-3665cfe7a889-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Lock "cinder-dcf61686-841e-423e-b6ac-a5610a5a17f7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Acquiring lock "cinder-quobyte-dcf61686-841e-423e-b6ac-a5610a5a17f7" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Lock "cinder-quobyte-dcf61686-841e-423e-b6ac-a5610a5a17f7" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cdc18d-f34c-4210-8505-11256dd729c4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:03 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 Sep 08 07:40:03 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:03 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 Sep 08 07:40:03 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:03 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9" returned: 0 in 0.461s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77724a8-b48f-48c4-8f4f-7387cec9bcf2]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:03 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7" returned: 0 in 0.368s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:03 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7 Sep 08 07:40:03 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:03 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff Sep 08 07:40:03 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:03 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-dcf61686-841e-423e-b6ac-a5610a5a17f7" returned: 0 in 0.359s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Lock "cinder-quobyte-dcf61686-841e-423e-b6ac-a5610a5a17f7" released by "delete_volume" :: held 0.782s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:03 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" returned: 0 in 0.479s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:40:03 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:04 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Created reservations ['30569152-958b-4a5c-a181-edd21cc9db90', '0572d7c0-7dc7-48ef-9a2d-f9c333b73332', '6d5b07c0-e7a9-4f0f-be82-903e446753fc', 'a90d9f22-7507-463c-b51d-ce3145b6c49b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:04 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:04 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:04 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:04 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.303s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:04 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Deleted volume successfully. Sep 08 07:40:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d54d1541-56f2-466a-a9bc-37ce079fd83b tempest-ProjectReaderTests-2012143800 None] Lock "cinder-dcf61686-841e-423e-b6ac-a5610a5a17f7-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Flow 'volume_create_manager' (4c3cec62-8edc-4b20-ba5a-4b9425ec02db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d370eaa7-fc6a-4707-97fe-247eaddfbd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d370eaa7-fc6a-4707-97fe-247eaddfbd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499396664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4291cfec16d847c1888683dd2ee6011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:05Z,use_quota=True,user_id='db3c003673ef4787965d313113513448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258c8303-c1b6-4879-825d-9c2767a2e7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258c8303-c1b6-4879-825d-9c2767a2e7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42942a1-c6fe-4db0-8aeb-d08894e8c96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42942a1-c6fe-4db0-8aeb-d08894e8c96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974', 'volume_name': 'volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e272932-57af-4238-ab96-800f8a762557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e272932-57af-4238-ab96-800f8a762557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4f5d8e-c974-4bba-ab00-ca7c9151be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:05 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Volume 1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974', 'volume_size': 1} Sep 08 07:40:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:08 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423" returned: 0 in 4.979s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:08 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:40:08 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Converted 1024.00 MB image at 205.60 MB/s Sep 08 07:40:08 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 is being set with open permissions: ugo+rw Sep 08 07:40:08 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:09 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 Sep 08 07:40:09 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:09 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423" returned: 0 in 0.248s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-f6b8e154-5b85-4867-8bb9-b2c597fa3423" released by "_copy_volume_from_snapshot" :: held 6.316s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-9e86e4d8-fa61-4e4f-ae3c-17755332c3d9-f6b8e154-5b85-4867-8bb9-b2c597fa3423" released by "_create_volume_from_snapshot" :: held 6.425s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.478s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.344s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Creating offline snapshot b178ec5b-002b-452f-9099-47ab16550e18 of volume 4a131df2-ffb1-4fc7-9efc-43e6545d7843 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa418002-8e33-4d3c-9e8c-5651da6748ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423', 'volume_size': 1, 'snapshot_id': '9e86e4d8-fa61-4e4f-ae3c-17755332c3d9'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2d2a30-486f-4afc-9604-8bb2a6c71075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ed38e6-446b-4c25-bdd8-7273ea318180]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:09 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Volume volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 (f6b8e154-5b85-4867-8bb9-b2c597fa3423): created successfully Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2d2a30-486f-4afc-9604-8bb2a6c71075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Flow 'volume_create_manager' (c56fac2e-23ea-402d-b058-c4291129af85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:09 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-db3c7527-6a76-4ac1-bea6-ef99146aabf0 tempest-VolumeDependencyTests-807358281 None] Created volume successfully. Sep 08 07:40:09 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 Sep 08 07:40:09 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (3f8713fd-d320-4cc4-8315-ef00294a15f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea866ce-bd84-4290-a547-259538621f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "cinder-9e86e4d8-fa61-4e4f-ae3c-17755332c3d9-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea866ce-bd84-4290-a547-259538621f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903231284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487e905a-3e7c-4cef-839b-f12797748cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:09Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8480a2b-2837-4bef-a07d-f884f3cb7a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8480a2b-2837-4bef-a07d-f884f3cb7a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cd3c6f-4d16-4d55-935c-70e149dea8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cd3c6f-4d16-4d55-935c-70e149dea8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487e905a-3e7c-4cef-839b-f12797748cb5', 'volume_name': 'volume-487e905a-3e7c-4cef-839b-f12797748cb5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26136708-69ee-4839-9813-32a82b463cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26136708-69ee-4839-9813-32a82b463cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0803ca7c-0f69-4452-a233-9d4f00414344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:09 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Volume 487e905a-3e7c-4cef-839b-f12797748cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487e905a-3e7c-4cef-839b-f12797748cb5', 'volume_size': 1} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-9e86e4d8-fa61-4e4f-ae3c-17755332c3d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "cinder-quobyte-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "cinder-quobyte-9e86e4d8-fa61-4e4f-ae3c-17755332c3d9" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-9e86e4d8-fa61-4e4f-ae3c-17755332c3d9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Deleting offline snapshot 9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 of volume 188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] snapshot_file for this snap is: volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea102963-bbf2-4a8d-9475-49c3e8c911c7]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:09 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843" returned: 0 in 0.424s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:09 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:09 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 1G Sep 08 07:40:09 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:09 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 Sep 08 07:40:09 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:10 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9" returned: 0 in 0.362s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130f021-1041-4661-827a-dce27e6fcffc]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:10 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 1G" returned: 0 in 0.401s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:10 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff Sep 08 07:40:10 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:10 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 Sep 08 07:40:10 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:10 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18" returned: 0 in 0.331s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:10 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 is being set with open permissions: ugo+rw Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:10 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 Sep 08 07:40:10 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:10 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" returned: 0 in 0.545s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:10 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 Sep 08 07:40:10 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:10 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18" returned: 0 in 0.251s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=239,cinder:UPDATE=316,cinder:INSERT=94,cinder:DELETE=24 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:10 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.info Sep 08 07:40:10 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:10 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9" returned: 0 in 0.345s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:10 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:11 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9 Sep 08 07:40:11 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:11 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.info" returned: 0 in 0.261s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:11 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.info is being set with open permissions: ugo+rw Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:11 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.info Sep 08 07:40:11 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:11 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff.9e86e4d8-fa61-4e4f-ae3c-17755332c3d9" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=322,cinder:SELECT=236,cinder:INSERT=75,cinder:DELETE=34 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-9e86e4d8-fa61-4e4f-ae3c-17755332c3d9" released by "_delete_snapshot" :: held 1.601s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" released by "delete_snapshot" :: held 1.624s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:11 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.info" returned: 0 in 0.257s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.864s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499396664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4291cfec16d847c1888683dd2ee6011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:05Z,use_quota=True,user_id='db3c003673ef4787965d313113513448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Creating volume 1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:11 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:11 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 1073741824 Sep 08 07:40:11 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:11 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3111bb52-ecff-46be-8f6f-0f1b91479ac4 tempest-ProjectMemberTests-1654685749 None] Create snapshot completed successfully Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Created reservations ['aa0fb5bf-9f63-4e74-9e1b-07c7bcc78da1', 'e10a6a66-ced6-4672-b887-715da90233ae', '4a3abb96-df65-4992-81e9-26ac061b1236', '94aaf4f5-5220-40d0-b69e-be06f0cc7ee5'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:11 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Delete snapshot completed successfully. Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a5bba6aa-402f-4b21-b92c-ce888cdfc418 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-9e86e4d8-fa61-4e4f-ae3c-17755332c3d9-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "cinder-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "cinder-quobyte-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:11 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 1073741824" returned: 0 in 0.462s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c94165a-3b45-4226-9312-1434ca5405c3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:11 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:11 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 Sep 08 07:40:11 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:11 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff Sep 08 07:40:11 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:12 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974" returned: 0 in 0.252s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.509s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903231284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487e905a-3e7c-4cef-839b-f12797748cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:09Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Creating volume 487e905a-3e7c-4cef-839b-f12797748cb5 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:12 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4f5d8e-c974-4bba-ab00-ca7c9151be84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e844ae9-36ab-48c8-9901-8c8c55df90d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:12 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 1073741824 Sep 08 07:40:12 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:12 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Volume volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 (1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974): created successfully Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e844ae9-36ab-48c8-9901-8c8c55df90d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Flow 'volume_create_manager' (4c3cec62-8edc-4b20-ba5a-4b9425ec02db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:12 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:12 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d88f3531-669f-4b6e-b0d0-24ffecc5390c tempest-ProjectReaderTests-2012143800 None] Created volume successfully. Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" returned: 0 in 0.379s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:12 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff Sep 08 07:40:12 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:12 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-b178ec5b-002b-452f-9099-47ab16550e18-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" returned: 0 in 0.259s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Lock "cinder-b178ec5b-002b-452f-9099-47ab16550e18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-4a131df2-ffb1-4fc7-9efc-43e6545d7843" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff" released by "delete_volume" :: held 0.719s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-4a131df2-ffb1-4fc7-9efc-43e6545d7843" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-b178ec5b-002b-452f-9099-47ab16550e18" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-b178ec5b-002b-452f-9099-47ab16550e18" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Deleting offline snapshot b178ec5b-002b-452f-9099-47ab16550e18 of volume 4a131df2-ffb1-4fc7-9efc-43e6545d7843 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] snapshot_file for this snap is: volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba535915-52ac-49c9-928a-b5f4f4c86544]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Created reservations ['09495c81-86f8-4c7e-8034-b5d39f9f03ea', '069834dc-9dd3-45f4-bcf1-e62d257247b2', 'ce141969-5c37-47b3-9bd6-1069ae88ffc7', 'bb81a975-b220-4ccf-87a7-c5315d832099'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:12 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 1073741824" returned: 0 in 0.549s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:12 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 Sep 08 07:40:12 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "cinder-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:12 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:12 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:12 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 Sep 08 07:40:12 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Lock "cinder-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "cinder-quobyte-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Lock "cinder-quobyte-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974" acquired by "delete_volume" :: waited 0.033s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[212dba2a-fc1f-4497-8290-1349dc6615ba]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:12 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Acquiring lock "cinder-f6b8e154-5b85-4867-8bb9-b2c597fa3423-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Lock "cinder-f6b8e154-5b85-4867-8bb9-b2c597fa3423-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Acquiring lock "cinder-quobyte-f6b8e154-5b85-4867-8bb9-b2c597fa3423" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:13 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-f6b8e154-5b85-4867-8bb9-b2c597fa3423" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5" returned: 0 in 0.379s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:13 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0803ca7c-0f69-4452-a233-9d4f00414344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487e905a-3e7c-4cef-839b-f12797748cb5', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:13 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a47f32d-43c8-4580-bda7-31a0e3b31f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[067adc48-9c15-4b71-9d3f-e2b5464419fc]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:13 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:13 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18" returned: 0 in 0.571s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.443s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:13 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Deleted volume successfully. Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f10a542-17c7-400e-bf9b-957d22b43d3c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:13 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Volume volume-487e905a-3e7c-4cef-839b-f12797748cb5 (487e905a-3e7c-4cef-839b-f12797748cb5): created successfully Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a47f32d-43c8-4580-bda7-31a0e3b31f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (3f8713fd-d320-4cc4-8315-ef00294a15f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:13 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-dfa7aeb4-e594-4783-a2eb-a2dd8738c5e4 tempest-ProjectReaderTests-1685362278 None] Created volume successfully. Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-33442674-962a-4df2-8625-78e5a0223470 tempest-VolumeDependencyTests-807358281 None] Lock "cinder-188b679d-0aa3-4fb6-bcf7-1bdb036b99ff-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:13 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 Sep 08 07:40:13 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:13 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 Sep 08 07:40:13 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:13 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974" returned: 0 in 0.491s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:13 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974 Sep 08 07:40:13 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:13 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423" returned: 0 in 0.390s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:13 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423 Sep 08 07:40:13 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:13 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843" returned: 0 in 0.425s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:13 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 Sep 08 07:40:13 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:13 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974" returned: 0 in 0.297s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Lock "cinder-quobyte-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974" released by "delete_volume" :: held 0.845s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Created reservations ['0d7d0394-35e9-4cd8-9714-b74b8cd44446', '5b2ff36c-446a-4796-baa5-4a2dee39ad0f', 'c41a2de5-5177-4a8e-b80f-d6920cfbcb2c', '1edfff96-a8a5-440d-a3c1-2ce66f33d62f'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:13 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f6b8e154-5b85-4867-8bb9-b2c597fa3423" returned: 0 in 0.303s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Lock "cinder-quobyte-f6b8e154-5b85-4867-8bb9-b2c597fa3423" released by "delete_volume" :: held 0.758s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:13 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:14 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:14 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Created reservations ['58120669-2ceb-4fa4-97a0-cdbd44cbb391', 'f2d5c75f-02f3-4274-a684-5878f38ef505', '3767c958-4220-484b-a608-8fa817b72a0e', 'd88ef43f-efec-48b3-87db-cd86bbc4618a'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Creating offline snapshot 1e2040d9-a725-4f2f-9e13-8d58962ac23f of volume 487e905a-3e7c-4cef-839b-f12797748cb5 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00a73ff-48f9-41b7-9553-4cfbce05136d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:14 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18" returned: 0 in 0.502s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:14 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18 Sep 08 07:40:14 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:14 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:14 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:14 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 Sep 08 07:40:14 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:14 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.371s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Deleted volume successfully. Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-5b0975df-a1fe-485f-8b31-9b40108fd362 tempest-ProjectReaderTests-2012143800 None] Lock "cinder-1a06b479-ac1d-4eed-b5f8-ed9bbbfdb974-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:14 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843.b178ec5b-002b-452f-9099-47ab16550e18" returned: 0 in 0.444s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-b178ec5b-002b-452f-9099-47ab16550e18" released by "_delete_snapshot" :: held 2.097s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-4a131df2-ffb1-4fc7-9efc-43e6545d7843" released by "delete_snapshot" :: held 2.133s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:14 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5" returned: 0 in 0.637s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:14 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:14 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f 1G Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.559s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:14 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:14 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Deleted volume successfully. Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Flow 'volume_create_manager' (20acfba9-335d-4d5a-9c8b-6faadc3fe2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bb9e41-b167-42cc-96fe-9fda6d492974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Created reservations ['ff256b68-b9b9-4208-b4d1-1c0bc9e8f845', '2515cc80-6db8-47fc-9f88-4f9f1037deab', '0f903d8e-07ff-41b2-8e76-15b0a825fdf1', '736ae22e-c217-4bc2-b58c-fd876aacf540'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-670e5b9c-51e9-44ad-b0a8-2b7f380a226a tempest-VolumeDependencyTests-807358281 None] Lock "cinder-f6b8e154-5b85-4867-8bb9-b2c597fa3423-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bb9e41-b167-42cc-96fe-9fda6d492974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10309532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2aec7d4-dbd7-4dea-bb22-e632838072db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4291cfec16d847c1888683dd2ee6011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:15Z,use_quota=True,user_id='db3c003673ef4787965d313113513448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82eca706-b039-4979-8362-98c3c9c3bb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82eca706-b039-4979-8362-98c3c9c3bb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32063af-7b5a-4fa1-8d58-1440facffa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32063af-7b5a-4fa1-8d58-1440facffa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2aec7d4-dbd7-4dea-bb22-e632838072db', 'volume_name': 'volume-d2aec7d4-dbd7-4dea-bb22-e632838072db', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e754d3-3f08-49f2-8eb3-873720bad7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e754d3-3f08-49f2-8eb3-873720bad7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cafd7e-c33a-4a80-a315-3e9e1dc5b61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:14 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Volume d2aec7d4-dbd7-4dea-bb22-e632838072db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2aec7d4-dbd7-4dea-bb22-e632838072db', 'volume_size': 1} Sep 08 07:40:14 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:15 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Delete snapshot completed successfully. Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bd6ba41-1120-4e30-90f4-7658e825a89a tempest-ProjectMemberTests-1654685749 None] Lock "cinder-b178ec5b-002b-452f-9099-47ab16550e18-delete_snapshot" released by "delete_snapshot" :: held 2.507s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:15 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f 1G" returned: 0 in 0.521s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487e905a-3e7c-4cef-839b-f12797748cb5 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:15 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487e905a-3e7c-4cef-839b-f12797748cb5 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f Sep 08 07:40:15 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:15 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487e905a-3e7c-4cef-839b-f12797748cb5 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f" returned: 0 in 0.314s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:15 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f is being set with open permissions: ugo+rw Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:15 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f Sep 08 07:40:15 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-4a131df2-ffb1-4fc7-9efc-43e6545d7843-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-4a131df2-ffb1-4fc7-9efc-43e6545d7843-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-4a131df2-ffb1-4fc7-9efc-43e6545d7843" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-4a131df2-ffb1-4fc7-9efc-43e6545d7843" acquired by "delete_volume" :: waited 0.030s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:15 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f" returned: 0 in 0.322s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0619568-7acf-497b-a7cc-04d3b6e8f2df]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:15 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:15 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.info Sep 08 07:40:15 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:16 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 Sep 08 07:40:16 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:16 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.info" returned: 0 in 0.271s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:16 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.info is being set with open permissions: ugo+rw Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:16 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.info Sep 08 07:40:16 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:16 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843" returned: 0 in 0.388s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:16 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843 Sep 08 07:40:16 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:16 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.info" returned: 0 in 0.267s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10309532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2aec7d4-dbd7-4dea-bb22-e632838072db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4291cfec16d847c1888683dd2ee6011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:15Z,use_quota=True,user_id='db3c003673ef4787965d313113513448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Creating volume d2aec7d4-dbd7-4dea-bb22-e632838072db {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:16 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:16 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db 1073741824 Sep 08 07:40:16 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:16 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-19868806-56b8-4e54-9e85-17e23b4952d2 tempest-ProjectReaderTests-1685362278 None] Create snapshot completed successfully Sep 08 07:40:16 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-4a131df2-ffb1-4fc7-9efc-43e6545d7843" returned: 0 in 0.277s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-4a131df2-ffb1-4fc7-9efc-43e6545d7843" released by "delete_volume" :: held 0.746s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Created reservations ['a9fdfeda-4e7f-485c-8e16-4cb904e7de33', '184239ed-2404-4dba-9452-3a6f824659e2', '985ba357-11dd-4312-bd3b-176eba4d7ebe', '4ebb7308-c852-49e1-a2f8-875a611c13f3'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:16 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:16 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:16 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:17 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.312s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Deleted volume successfully. Sep 08 07:40:17 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db 1073741824" returned: 0 in 0.558s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-265d08db-e3da-4eea-adc7-38c8e2f5778f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-4a131df2-ffb1-4fc7-9efc-43e6545d7843-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:17 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db Sep 08 07:40:17 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:17 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db" returned: 0 in 0.351s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cafd7e-c33a-4a80-a315-3e9e1dc5b61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2aec7d4-dbd7-4dea-bb22-e632838072db', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95898a18-eb1c-4c86-b24a-11777c4ee01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-1e2040d9-a725-4f2f-9e13-8d58962ac23f-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Volume volume-d2aec7d4-dbd7-4dea-bb22-e632838072db (d2aec7d4-dbd7-4dea-bb22-e632838072db): created successfully Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95898a18-eb1c-4c86-b24a-11777c4ee01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Flow 'volume_create_manager' (20acfba9-335d-4d5a-9c8b-6faadc3fe2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-1e2040d9-a725-4f2f-9e13-8d58962ac23f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-487e905a-3e7c-4cef-839b-f12797748cb5" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (78d79ed0-846a-4ce6-8af4-642c30cba626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5680433c-afbd-4393-b6ce-2d8d7fdff32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:17 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-08fe4550-3a7a-4932-8cbf-45de251283d3 tempest-ProjectReaderTests-2012143800 None] Created volume successfully. Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-487e905a-3e7c-4cef-839b-f12797748cb5" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-1e2040d9-a725-4f2f-9e13-8d58962ac23f" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5680433c-afbd-4393-b6ce-2d8d7fdff32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417527076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b21adc-9ba3-450a-9178-e31e8e7d2eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:18Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d135d56-bdf1-40cc-ae1e-3d88298977fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d135d56-bdf1-40cc-ae1e-3d88298977fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886adce7-5b8b-427a-b40b-5e6d5e0cf702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886adce7-5b8b-427a-b40b-5e6d5e0cf702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b21adc-9ba3-450a-9178-e31e8e7d2eaf', 'volume_name': 'volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e658a8f9-702d-4b2d-9626-37f73e17c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e658a8f9-702d-4b2d-9626-37f73e17c410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8c9229-c57f-41d4-9bda-f232959380dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Volume 95b21adc-9ba3-450a-9178-e31e8e7d2eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf', 'volume_size': 1} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417527076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b21adc-9ba3-450a-9178-e31e8e7d2eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:18Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Creating volume 95b21adc-9ba3-450a-9178-e31e8e7d2eaf {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:17 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-1e2040d9-a725-4f2f-9e13-8d58962ac23f" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Deleting offline snapshot 1e2040d9-a725-4f2f-9e13-8d58962ac23f of volume 487e905a-3e7c-4cef-839b-f12797748cb5 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:17 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf 1073741824 Sep 08 07:40:17 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] snapshot_file for this snap is: volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cc7af6-8780-402d-8f74-77fdc5e115e4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:17 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f Sep 08 07:40:17 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "cinder-d2aec7d4-dbd7-4dea-bb22-e632838072db-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Lock "cinder-d2aec7d4-dbd7-4dea-bb22-e632838072db-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "cinder-quobyte-d2aec7d4-dbd7-4dea-bb22-e632838072db" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Lock "cinder-quobyte-d2aec7d4-dbd7-4dea-bb22-e632838072db" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2166bc2b-ac10-4760-8e4a-7695f0ee0295]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:18 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf 1073741824" returned: 0 in 0.543s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:18 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f" returned: 0 in 0.509s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487e905a-3e7c-4cef-839b-f12797748cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[02564f32-d268-4ff2-803f-de2f475b24b4]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:18 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db Sep 08 07:40:18 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:18 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf Sep 08 07:40:18 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:18 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 Sep 08 07:40:18 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:18 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db" returned: 0 in 0.499s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:18 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" returned: 0 in 0.338s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:18 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db Sep 08 07:40:18 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8c9229-c57f-41d4-9bda-f232959380dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09965ff4-cc13-408f-8bc3-40420b5f1258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:18 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Volume volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf (95b21adc-9ba3-450a-9178-e31e8e7d2eaf): created successfully Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09965ff4-cc13-408f-8bc3-40420b5f1258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (78d79ed0-846a-4ce6-8af4-642c30cba626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:18 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5" returned: 0 in 0.445s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:18 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ceb085b1-3174-4e27-91de-55ddfa4a7ee2 tempest-ProjectMemberTests-1654685749 None] Created volume successfully. Sep 08 07:40:18 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f Sep 08 07:40:18 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:18 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-d2aec7d4-dbd7-4dea-bb22-e632838072db" returned: 0 in 0.297s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Lock "cinder-quobyte-d2aec7d4-dbd7-4dea-bb22-e632838072db" released by "delete_volume" :: held 0.845s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Created reservations ['c69ad54c-612f-4623-ac64-d8e6c1b0d84e', '669e65ee-f733-42bc-9ecb-5f24251e99c6', 'b4890348-e8b0-45d2-bd08-78c970b04f07', 'e8b40022-db00-4bd5-bb27-af5f68f9cb9d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:19 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:19 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:19 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f" returned: 0 in 0.421s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:19 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f Sep 08 07:40:19 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:19 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.287s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Deleted volume successfully. Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-1cb60663-50c2-4c46-9cc2-e2ece28fdb39 tempest-ProjectReaderTests-2012143800 None] Lock "cinder-d2aec7d4-dbd7-4dea-bb22-e632838072db-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:19 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5.1e2040d9-a725-4f2f-9e13-8d58962ac23f" returned: 0 in 0.333s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-1e2040d9-a725-4f2f-9e13-8d58962ac23f" released by "_delete_snapshot" :: held 1.824s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-487e905a-3e7c-4cef-839b-f12797748cb5" released by "delete_snapshot" :: held 1.911s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Created reservations ['13941f19-35dc-46c7-9e41-330b800ef197', 'a9d3aa7f-e596-4a28-9810-d38eeeba89bd', '9aa5b03b-388b-4fe7-ad81-748feed0d112', '8113a77d-dc8c-478a-b67f-12528f5d7c47'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Delete snapshot completed successfully. Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-d8ea5d57-9938-4558-aa1e-cc8c6396257b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-1e2040d9-a725-4f2f-9e13-8d58962ac23f-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Creating offline snapshot 531bff1f-9495-495d-bc02-2a7b3a3520a1 of volume 95b21adc-9ba3-450a-9178-e31e8e7d2eaf {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e5af26-e835-4d96-80aa-56376a4fe75a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:20 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf Sep 08 07:40:20 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:20 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:20 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 1G Sep 08 07:40:20 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-487e905a-3e7c-4cef-839b-f12797748cb5-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:20 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Lock "cinder-487e905a-3e7c-4cef-839b-f12797748cb5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 1G" returned: 0 in 0.564s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:20 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 Sep 08 07:40:20 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-487e905a-3e7c-4cef-839b-f12797748cb5" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:20 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-487e905a-3e7c-4cef-839b-f12797748cb5" acquired by "delete_volume" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c2947e-626a-4216-84d8-1d2338de60f9]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:21 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 Sep 08 07:40:21 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:21 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1" returned: 0 in 0.410s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:21 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 is being set with open permissions: ugo+rw Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:21 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 Sep 08 07:40:21 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:21 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5" returned: 0 in 0.529s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:21 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1" returned: 0 in 0.287s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:21 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5 Sep 08 07:40:21 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:21 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.info Sep 08 07:40:21 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:21 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-487e905a-3e7c-4cef-839b-f12797748cb5" returned: 0 in 0.276s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-487e905a-3e7c-4cef-839b-f12797748cb5" released by "delete_volume" :: held 0.893s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:21 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.info" returned: 0 in 0.287s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:21 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.info is being set with open permissions: ugo+rw Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:21 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Created reservations ['5a76ea55-dbfe-4c7a-9d47-1a7ae81c7871', 'fc71b22b-5050-4ed2-ad43-d74c44307aaf', 'fb0e5bc0-b60d-4f2a-adff-d8c476656029', '592aee91-9665-4e9e-b87f-f2ea058dcc99'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:21 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.info Sep 08 07:40:21 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:22 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:22 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:22 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.info" returned: 0 in 0.248s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1202abe2-b831-4d11-a48d-bcd9724c93b9 tempest-ProjectMemberTests-1654685749 None] Create snapshot completed successfully Sep 08 07:40:22 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.258s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Deleted volume successfully. Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-7b2a6193-49f6-498a-90ec-102342d3d64d tempest-ProjectReaderTests-1685362278 None] Lock "cinder-487e905a-3e7c-4cef-839b-f12797748cb5-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (16572468-0fa5-40e2-ac28-03e47a1f8e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee6a560-422f-43b4-9d91-595072bbd739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee6a560-422f-43b4-9d91-595072bbd739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071799461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:22Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6955151-82da-4df4-9b28-4779f780b7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6955151-82da-4df4-9b28-4779f780b7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50459a80-697f-4a5a-9363-b3cecbc7bec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50459a80-697f-4a5a-9363-b3cecbc7bec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae', 'volume_name': 'volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e65594d-9f65-4f30-b7a1-21ce5962ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e65594d-9f65-4f30-b7a1-21ce5962ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115ddc59-e0f5-4590-81d2-ec4d880379ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:22 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Volume f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae', 'volume_size': 1} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071799461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:22Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Creating volume f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:22 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:22 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae 1073741824 Sep 08 07:40:22 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:23 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae 1073741824" returned: 0 in 0.429s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-531bff1f-9495-495d-bc02-2a7b3a3520a1-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-531bff1f-9495-495d-bc02-2a7b3a3520a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:23 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae Sep 08 07:40:23 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-531bff1f-9495-495d-bc02-2a7b3a3520a1" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-531bff1f-9495-495d-bc02-2a7b3a3520a1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Deleting offline snapshot 531bff1f-9495-495d-bc02-2a7b3a3520a1 of volume 95b21adc-9ba3-450a-9178-e31e8e7d2eaf {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] snapshot_file for this snap is: volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36cb7d0-dee3-468a-9710-56dfd461202e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:23 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 Sep 08 07:40:23 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:23 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" returned: 0 in 0.263s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115ddc59-e0f5-4590-81d2-ec4d880379ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f00c61-7053-4bbe-8699-506da4c89c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:23 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Volume volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae (f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae): created successfully Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f00c61-7053-4bbe-8699-506da4c89c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (16572468-0fa5-40e2-ac28-03e47a1f8e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:23 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6f13ae11-cce1-45b1-bf28-bcdc26a926b7 tempest-ProjectReaderTests-1685362278 None] Created volume successfully. Sep 08 07:40:23 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1" returned: 0 in 0.398s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1530fd97-5355-4e39-a403-d783a5de16e0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:23 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf Sep 08 07:40:23 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Creating offline snapshot 3236dc0b-33a2-4106-a8d3-aa650f651f20 of volume f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf75a01-6ef7-4159-83e3-7886490a1210]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:23 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae Sep 08 07:40:23 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:23 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" returned: 0 in 0.385s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:23 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:24 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 Sep 08 07:40:24 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:24 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" returned: 0 in 0.371s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:24 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 1G Sep 08 07:40:24 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:24 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1" returned: 0 in 0.334s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:24 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1 Sep 08 07:40:24 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:24 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 1G" returned: 0 in 0.386s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:24 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 Sep 08 07:40:24 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:24 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf.531bff1f-9495-495d-bc02-2a7b3a3520a1" returned: 0 in 0.262s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-531bff1f-9495-495d-bc02-2a7b3a3520a1" released by "_delete_snapshot" :: held 1.471s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" released by "delete_snapshot" :: held 1.493s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Created reservations ['363301a4-d944-4d9e-b0a6-557df10ff6a0', 'fa47cefc-948a-4eed-9d5a-e3d857625e7c', '6450f2a9-8e05-4661-9703-f7da6c7fa855', '9326e270-ef9d-44c3-ba62-82d1e6f25ec4'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:24 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Delete snapshot completed successfully. Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-64f1ef93-bcda-46c8-9ac9-0dc07e2e882f tempest-ProjectMemberTests-1654685749 None] Lock "cinder-531bff1f-9495-495d-bc02-2a7b3a3520a1-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:24 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20" returned: 0 in 0.317s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:24 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 is being set with open permissions: ugo+rw Sep 08 07:40:24 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:24 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 Sep 08 07:40:24 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:25 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20" returned: 0 in 0.251s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:25 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.info Sep 08 07:40:25 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-95b21adc-9ba3-450a-9178-e31e8e7d2eaf-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-95b21adc-9ba3-450a-9178-e31e8e7d2eaf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:25 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.info" returned: 0 in 0.268s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:25 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.info is being set with open permissions: ugo+rw Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[061ba241-08c0-4c76-9643-ce4ef17d5230]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:25 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.info Sep 08 07:40:25 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:25 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf Sep 08 07:40:25 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:25 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.info" returned: 0 in 0.238s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:25 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-71ab74f3-3ad7-4c6a-a22e-f7d81e2222a2 tempest-ProjectReaderTests-1685362278 None] Create snapshot completed successfully Sep 08 07:40:25 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" returned: 0 in 0.367s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:25 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf Sep 08 07:40:25 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-3236dc0b-33a2-4106-a8d3-aa650f651f20-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-3236dc0b-33a2-4106-a8d3-aa650f651f20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-3236dc0b-33a2-4106-a8d3-aa650f651f20" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-3236dc0b-33a2-4106-a8d3-aa650f651f20" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Deleting offline snapshot 3236dc0b-33a2-4106-a8d3-aa650f651f20 of volume f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] snapshot_file for this snap is: volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c02c5a9-a5f8-4125-9e22-d33edaa7135e]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:25 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:26 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" returned: 0 in 0.272s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-95b21adc-9ba3-450a-9178-e31e8e7d2eaf" released by "delete_volume" :: held 0.707s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:26 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 Sep 08 07:40:26 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Created reservations ['f856fb9b-5a3b-4994-bfaa-495b052b3668', '7db1775c-f5f2-4cd7-8378-edc59c59eec6', '0bc19c03-8e6a-423b-8a3d-34f16507e45f', '1708f646-445d-4c6b-881d-aeae446670d5'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:26 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:26 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:26 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20" returned: 0 in 0.385s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[990c7682-cac8-49f0-8900-9d3dd3432ed0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:26 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.268s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:26 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Deleted volume successfully. Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-4dc95f01-9331-4cbc-84f0-acbfaba232e2 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-95b21adc-9ba3-450a-9178-e31e8e7d2eaf-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:26 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae Sep 08 07:40:26 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:26 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" returned: 0 in 0.410s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:26 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 Sep 08 07:40:26 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (6a617033-56f1-4d63-97cb-37a5986d2227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465c83d0-df8e-447d-9458-1849addf758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465c83d0-df8e-447d-9458-1849addf758d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274359633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447ffbc9-a675-4750-b550-8b8efd31f38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:27Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8639ad-16cd-4ec6-90d6-e9c2f170a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8639ad-16cd-4ec6-90d6-e9c2f170a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038d8212-a12e-4c5f-8495-4275d7da45d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038d8212-a12e-4c5f-8495-4275d7da45d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '447ffbc9-a675-4750-b550-8b8efd31f38f', 'volume_name': 'volume-447ffbc9-a675-4750-b550-8b8efd31f38f', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0641c731-a1f7-40cb-88ee-cd754346e120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0641c731-a1f7-40cb-88ee-cd754346e120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56b54f3-5264-4b91-912a-aac39c817ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:26 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Volume 447ffbc9-a675-4750-b550-8b8efd31f38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-447ffbc9-a675-4750-b550-8b8efd31f38f', 'volume_size': 1} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274359633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447ffbc9-a675-4750-b550-8b8efd31f38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:27Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Creating volume 447ffbc9-a675-4750-b550-8b8efd31f38f {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:26 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:27 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:27 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f 1073741824 Sep 08 07:40:27 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:27 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20" returned: 0 in 0.388s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:27 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20 Sep 08 07:40:27 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:27 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f 1073741824" returned: 0 in 0.407s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:27 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae.3236dc0b-33a2-4106-a8d3-aa650f651f20" returned: 0 in 0.291s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:27 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f Sep 08 07:40:27 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-3236dc0b-33a2-4106-a8d3-aa650f651f20" released by "_delete_snapshot" :: held 1.579s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" released by "delete_snapshot" :: held 1.599s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Created reservations ['de950486-d400-4784-a5fd-134b04ce9a8a', '38a41d8f-180a-4154-a1e7-1c6525bd6228', '784da925-d3f3-404c-a5a7-8aac13a3aba3', '115b5dc4-6878-437a-bc11-b61d7aae1879'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Delete snapshot completed successfully. Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-eef7097d-a643-49e7-856d-831f7a920ef3 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-3236dc0b-33a2-4106-a8d3-aa650f651f20-delete_snapshot" released by "delete_snapshot" :: held 1.739s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:27 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56b54f3-5264-4b91-912a-aac39c817ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-447ffbc9-a675-4750-b550-8b8efd31f38f', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2bd131-3e08-44a7-a3a5-d65422c3a8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:27 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Volume volume-447ffbc9-a675-4750-b550-8b8efd31f38f (447ffbc9-a675-4750-b550-8b8efd31f38f): created successfully Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2bd131-3e08-44a7-a3a5-d65422c3a8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:27 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (6a617033-56f1-4d63-97cb-37a5986d2227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:27 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-e5650ec7-da1d-45c2-91fb-59ba480f6bb0 tempest-ProjectMemberTests-1654685749 None] Created volume successfully. Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Creating offline snapshot 31ace336-4331-40ab-b719-2d52fd516576 of volume 447ffbc9-a675-4750-b550-8b8efd31f38f {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e553f439-c130-4863-b91e-6d85abc6cd40]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" acquired by "delete_volume" :: waited 0.027s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c384105-3d30-4ce1-b484-3e7a6c77284c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:28 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f Sep 08 07:40:28 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:28 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae Sep 08 07:40:28 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:28 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f" returned: 0 in 0.361s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:28 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 1G Sep 08 07:40:28 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:28 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" returned: 0 in 0.393s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:28 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae Sep 08 07:40:28 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:28 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" returned: 0 in 0.284s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae" released by "delete_volume" :: held 0.743s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Created reservations ['94a50877-eacd-4a2d-b149-57744b918e10', '0fd3697f-a3e6-4742-ba34-58bcc5f3f6d9', 'b11cbb0f-39f1-45e8-a837-4dfce74038f8', 'f3f5284e-9700-4750-9183-7c580b940c8e'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:28 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 1G" returned: 0 in 0.482s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:28 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-447ffbc9-a675-4750-b550-8b8efd31f38f -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:28 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-447ffbc9-a675-4750-b550-8b8efd31f38f -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 Sep 08 07:40:28 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:29 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:29 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:29 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-447ffbc9-a675-4750-b550-8b8efd31f38f -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576" returned: 0 in 0.319s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:29 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 is being set with open permissions: ugo+rw Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:29 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 Sep 08 07:40:29 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:29 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.261s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:29 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Deleted volume successfully. Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-616ef794-3b60-47a8-818d-b0e3605695f6 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-f733ca29-0f5a-4e95-8bf9-3d3d1ae4f4ae-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:29 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576" returned: 0 in 0.283s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:29 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.info Sep 08 07:40:29 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (8237304d-e123-471b-b5e8-860952de9089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943db091-4dd3-4228-a4ce-3fcbb3b0b8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943db091-4dd3-4228-a4ce-3fcbb3b0b8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50366741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e713cd-cdb1-4241-bc7b-44a8e4a8d61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:30Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbe00b9-5171-4748-8a48-c02f6c5f902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbe00b9-5171-4748-8a48-c02f6c5f902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d05a8e-87a6-430a-9ddc-0cefcd1862ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d05a8e-87a6-430a-9ddc-0cefcd1862ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e713cd-cdb1-4241-bc7b-44a8e4a8d61e', 'volume_name': 'volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6088d0b-f9c0-45f5-b5ef-9ef4de47997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6088d0b-f9c0-45f5-b5ef-9ef4de47997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfecd97-8e0a-4475-8a24-be5e968439ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:29 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Volume 98e713cd-cdb1-4241-bc7b-44a8e4a8d61e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e', 'volume_size': 1} Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:29 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.info" returned: 0 in 0.261s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:29 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.info is being set with open permissions: ugo+rw Sep 08 07:40:29 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:29 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.info Sep 08 07:40:29 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:30 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.info" returned: 0 in 0.243s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.348s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50366741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e713cd-cdb1-4241-bc7b-44a8e4a8d61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:30Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Creating volume 98e713cd-cdb1-4241-bc7b-44a8e4a8d61e {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:30 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:30 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e 1073741824 Sep 08 07:40:30 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:30 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c3ca7a27-67ae-4046-82b9-95dc4e764e2f tempest-ProjectMemberTests-1654685749 None] Create snapshot completed successfully Sep 08 07:40:30 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e 1073741824" returned: 0 in 0.406s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:30 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e Sep 08 07:40:30 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:30 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" returned: 0 in 0.245s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfecd97-8e0a-4475-8a24-be5e968439ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ec2119-06e4-4419-ac1a-68cf3bae274b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:30 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Volume volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e (98e713cd-cdb1-4241-bc7b-44a8e4a8d61e): created successfully Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ec2119-06e4-4419-ac1a-68cf3bae274b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:30 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (8237304d-e123-471b-b5e8-860952de9089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:30 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-3a05d7fa-6368-4143-a303-409789dbf59d tempest-ProjectReaderTests-1685362278 None] Created volume successfully. Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-31ace336-4331-40ab-b719-2d52fd516576-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Lock "cinder-31ace336-4331-40ab-b719-2d52fd516576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-447ffbc9-a675-4750-b550-8b8efd31f38f" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-447ffbc9-a675-4750-b550-8b8efd31f38f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-31ace336-4331-40ab-b719-2d52fd516576" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-31ace336-4331-40ab-b719-2d52fd516576" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Deleting offline snapshot 31ace336-4331-40ab-b719-2d52fd516576 of volume 447ffbc9-a675-4750-b550-8b8efd31f38f {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] snapshot_file for this snap is: volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbc26b1-43e1-4f84-9300-648a4181b0ed]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:31 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 Sep 08 07:40:31 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:31 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576" returned: 0 in 0.383s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-447ffbc9-a675-4750-b550-8b8efd31f38f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e05bee-e8fc-48f2-9fd5-4253b1662b28]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:31 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f Sep 08 07:40:31 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Creating offline snapshot bb228b11-bcbb-4ef0-9c48-f52905067f32 of volume 98e713cd-cdb1-4241-bc7b-44a8e4a8d61e {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c07b04-fc33-4e51-967a-3f7f4e6b813c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:31 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:32 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e Sep 08 07:40:32 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:32 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f" returned: 0 in 0.385s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:32 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 Sep 08 07:40:32 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:32 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" returned: 0 in 0.377s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:32 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 1G Sep 08 07:40:32 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:32 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576" returned: 0 in 0.357s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:32 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576 Sep 08 07:40:32 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:32 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 1G" returned: 0 in 0.406s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:32 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f.31ace336-4331-40ab-b719-2d52fd516576" returned: 0 in 0.282s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:32 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 Sep 08 07:40:32 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-31ace336-4331-40ab-b719-2d52fd516576" released by "_delete_snapshot" :: held 1.502s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-447ffbc9-a675-4750-b550-8b8efd31f38f" released by "delete_snapshot" :: held 1.525s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Created reservations ['d44a3539-dfaa-4be1-b790-679060ce9ad5', 'a23034ee-2a44-429b-a24d-df1c2be40dcd', 'f78cfb7d-aba4-4b94-bb78-6495a1814040', 'df1860d6-58b5-4b0f-90d9-8a7dd673dd42'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:32 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Delete snapshot completed successfully. Sep 08 07:40:32 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89cd0baf-954b-4c88-9aa9-97d9315a01fe tempest-ProjectMemberTests-1654685749 None] Lock "cinder-31ace336-4331-40ab-b719-2d52fd516576-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:33 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32" returned: 0 in 0.287s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:33 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 is being set with open permissions: ugo+rw Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:33 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 Sep 08 07:40:33 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:33 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32" returned: 0 in 0.242s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:33 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.info Sep 08 07:40:33 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-447ffbc9-a675-4750-b550-8b8efd31f38f-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-447ffbc9-a675-4750-b550-8b8efd31f38f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-447ffbc9-a675-4750-b550-8b8efd31f38f" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-447ffbc9-a675-4750-b550-8b8efd31f38f" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[da041881-3af6-4b6c-ae79-4616d3d9e4c0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:33 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.info" returned: 0 in 0.258s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:33 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.info is being set with open permissions: ugo+rw Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:33 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.info Sep 08 07:40:33 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:33 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f Sep 08 07:40:33 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:33 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.info" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:33 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:33 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-eb9429a8-beab-4ed9-b6bd-e84e1895eb9f tempest-ProjectReaderTests-1685362278 None] Create snapshot completed successfully Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f" returned: 0 in 0.363s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:33 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:33 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f Sep 08 07:40:33 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-bb228b11-bcbb-4ef0-9c48-f52905067f32-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-bb228b11-bcbb-4ef0-9c48-f52905067f32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-bb228b11-bcbb-4ef0-9c48-f52905067f32" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-bb228b11-bcbb-4ef0-9c48-f52905067f32" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:34 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Deleting offline snapshot bb228b11-bcbb-4ef0-9c48-f52905067f32 of volume 98e713cd-cdb1-4241-bc7b-44a8e4a8d61e {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] snapshot_file for this snap is: volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-447ffbc9-a675-4750-b550-8b8efd31f38f" returned: 0 in 0.280s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbe8dc3-4507-4303-9813-d2edfd5a9722]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-447ffbc9-a675-4750-b550-8b8efd31f38f" released by "delete_volume" :: held 0.715s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Created reservations ['c6584ad7-b07c-43b2-bcd3-6e1316d759be', 'b0a4ea3c-bee1-4844-b461-aa6fd7546a4a', 'c65bcb24-79cd-46bd-88d0-4007b89d1bd9', '61fe74e9-f72a-436b-b6da-b7cfd3fb1f7a'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:34 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 Sep 08 07:40:34 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:34 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:34 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:34 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32" returned: 0 in 0.389s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:34 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.278s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:34 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Deleted volume successfully. Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb46d790-199d-438a-a53d-35c85a69b9e0]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-026c5d41-ec92-4bd1-946a-72b39d25e313 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-447ffbc9-a675-4750-b550-8b8efd31f38f-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:34 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e Sep 08 07:40:34 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:34 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" returned: 0 in 0.409s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:34 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:35 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 Sep 08 07:40:35 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (5b162e25-4cd2-41fb-9e1c-8125d9f10d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f35969-882b-4526-853e-f1aba4919905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f35969-882b-4526-853e-f1aba4919905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914067541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a43100d-f96c-4be5-a72d-51ff92a5120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:35Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50d93b2-202c-4beb-8850-139bde86c412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50d93b2-202c-4beb-8850-139bde86c412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f787bf9-1bac-45dd-bb60-08ebd1708c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f787bf9-1bac-45dd-bb60-08ebd1708c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a43100d-f96c-4be5-a72d-51ff92a5120e', 'volume_name': 'volume-2a43100d-f96c-4be5-a72d-51ff92a5120e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd3aa03-9a3b-4671-a55a-3760758a5a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd3aa03-9a3b-4671-a55a-3760758a5a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e4b9c7-6d32-446d-a710-aae26510e0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:35 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Volume 2a43100d-f96c-4be5-a72d-51ff92a5120e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a43100d-f96c-4be5-a72d-51ff92a5120e', 'volume_size': 1} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914067541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a43100d-f96c-4be5-a72d-51ff92a5120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:35Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Creating volume 2a43100d-f96c-4be5-a72d-51ff92a5120e {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:35 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:35 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e 1073741824 Sep 08 07:40:35 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:35 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32" returned: 0 in 0.336s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:35 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32 Sep 08 07:40:35 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:35 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e 1073741824" returned: 0 in 0.423s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:35 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e.bb228b11-bcbb-4ef0-9c48-f52905067f32" returned: 0 in 0.274s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-bb228b11-bcbb-4ef0-9c48-f52905067f32" released by "_delete_snapshot" :: held 1.513s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" released by "delete_snapshot" :: held 1.547s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:35 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e Sep 08 07:40:35 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Created reservations ['2fe9f827-a2b9-4f32-9744-8c6b5e6dc939', 'c6ed9fd9-e9cc-4af8-aabe-17333b2e3f56', '916d1483-a9fa-41de-ab9d-c4156c82eedc', 'b9e0c908-8673-4221-a34c-2bc2345fb55b'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Delete snapshot completed successfully. Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-ca492f65-7907-4167-b4b6-7697e5fe26e5 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-bb228b11-bcbb-4ef0-9c48-f52905067f32-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:35 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e" returned: 0 in 0.251s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e4b9c7-6d32-446d-a710-aae26510e0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a43100d-f96c-4be5-a72d-51ff92a5120e', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d3d78b-815b-4c4a-b1eb-039ef950112d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:35 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Volume volume-2a43100d-f96c-4be5-a72d-51ff92a5120e (2a43100d-f96c-4be5-a72d-51ff92a5120e): created successfully Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d3d78b-815b-4c4a-b1eb-039ef950112d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:35 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (5b162e25-4cd2-41fb-9e1c-8125d9f10d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:35 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b52856d5-fc3a-4ed1-8dc3-4573bbef5f65 tempest-ProjectMemberTests-1654685749 None] Created volume successfully. Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Creating offline snapshot 55384847-8b00-4927-805d-e5a9dca195d0 of volume 2a43100d-f96c-4be5-a72d-51ff92a5120e {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fd026f-d534-48c3-8118-d5ff8c97a829]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" acquired by "delete_volume" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:36 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e Sep 08 07:40:36 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e60a799-7623-4f6c-ab7c-fdb2f3f6b60b]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:36 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e Sep 08 07:40:36 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:36 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e" returned: 0 in 0.380s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:36 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 1G Sep 08 07:40:36 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:36 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" returned: 0 in 0.371s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:36 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e Sep 08 07:40:36 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:36 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:36 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 1G" returned: 0 in 0.407s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:36 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a43100d-f96c-4be5-a72d-51ff92a5120e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e" released by "delete_volume" :: held 0.706s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:37 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a43100d-f96c-4be5-a72d-51ff92a5120e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 Sep 08 07:40:37 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Created reservations ['f02807a1-e73a-4af4-ac2a-d306a60be546', '785af164-b5ac-4ccb-86e1-471780f8a7f6', '11ee61d7-2b0c-4b80-8f49-19d428276857', '6a4e49bf-8ac3-4797-a857-52416e824647'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:37 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:37 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:37 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a43100d-f96c-4be5-a72d-51ff92a5120e -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0" returned: 0 in 0.298s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:37 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 is being set with open permissions: ugo+rw Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:37 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 Sep 08 07:40:37 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:37 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.271s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:37 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Deleted volume successfully. Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-b2ae3486-6a77-4b4e-be6b-e4a0f8074d55 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-98e713cd-cdb1-4241-bc7b-44a8e4a8d61e-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:37 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0" returned: 0 in 0.271s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:37 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.info Sep 08 07:40:37 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:37 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (d0e68374-e891-4f8c-829d-75bac50698a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac385d28-15fc-45fd-bdc9-81ee065cd135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.info" returned: 0 in 0.304s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:37 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.info is being set with open permissions: ugo+rw Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac385d28-15fc-45fd-bdc9-81ee065cd135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667013862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acf0540-6521-474d-8bff-99474148ce82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:38Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:37 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.info Sep 08 07:40:37 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fbfe68-48b1-4124-809d-56a26db4a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fbfe68-48b1-4124-809d-56a26db4a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4488391-ac2e-4b94-ad28-f01183f8d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4488391-ac2e-4b94-ad28-f01183f8d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6acf0540-6521-474d-8bff-99474148ce82', 'volume_name': 'volume-6acf0540-6521-474d-8bff-99474148ce82', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc42a0a7-1fb0-413a-ac05-be80e4b14a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc42a0a7-1fb0-413a-ac05-be80e4b14a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0f1f63-3e5f-45ab-a0cf-ddbc771edc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:37 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Volume 6acf0540-6521-474d-8bff-99474148ce82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6acf0540-6521-474d-8bff-99474148ce82', 'volume_size': 1} Sep 08 07:40:37 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:38 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.info" returned: 0 in 0.249s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.202s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667013862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acf0540-6521-474d-8bff-99474148ce82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:38Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Creating volume 6acf0540-6521-474d-8bff-99474148ce82 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:38 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:38 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 1073741824 Sep 08 07:40:38 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-41757e6a-55b2-44d7-a584-fd21359c1ca6 tempest-ProjectMemberTests-1654685749 None] Create snapshot completed successfully Sep 08 07:40:38 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 1073741824" returned: 0 in 0.419s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:38 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 Sep 08 07:40:38 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:38 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82" returned: 0 in 0.252s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0f1f63-3e5f-45ab-a0cf-ddbc771edc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6acf0540-6521-474d-8bff-99474148ce82', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcc3e4c-3625-457c-8ef5-b8c52077694f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:38 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Volume volume-6acf0540-6521-474d-8bff-99474148ce82 (6acf0540-6521-474d-8bff-99474148ce82): created successfully Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcc3e4c-3625-457c-8ef5-b8c52077694f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:38 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (d0e68374-e891-4f8c-829d-75bac50698a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:38 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-366e6ff4-e9ad-4951-bae9-e42f99596db6 tempest-ProjectReaderTests-1685362278 None] Created volume successfully. Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-55384847-8b00-4927-805d-e5a9dca195d0-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-55384847-8b00-4927-805d-e5a9dca195d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-2a43100d-f96c-4be5-a72d-51ff92a5120e" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-2a43100d-f96c-4be5-a72d-51ff92a5120e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-55384847-8b00-4927-805d-e5a9dca195d0" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-55384847-8b00-4927-805d-e5a9dca195d0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Deleting offline snapshot 55384847-8b00-4927-805d-e5a9dca195d0 of volume 2a43100d-f96c-4be5-a72d-51ff92a5120e {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] snapshot_file for this snap is: volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[700d7b57-a1e6-43d6-b003-c5df25e3aa7d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:39 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 Sep 08 07:40:39 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:39 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0" returned: 0 in 0.366s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a43100d-f96c-4be5-a72d-51ff92a5120e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[768e74d2-82be-4091-b67c-9bbd4cc0a030]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:39 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:39 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e Sep 08 07:40:39 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Creating offline snapshot 096efa7f-b70d-4bf6-8b00-c57484b0a5ec of volume 6acf0540-6521-474d-8bff-99474148ce82 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bec23ca-8c29-45ee-90a7-8d5f220eeee3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:40 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e" returned: 0 in 0.395s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:40 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 Sep 08 07:40:40 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:40 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 Sep 08 07:40:40 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:40 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82" returned: 0 in 0.370s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:40 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec 1G Sep 08 07:40:40 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:40 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0" returned: 0 in 0.346s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:40 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0 Sep 08 07:40:40 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:40 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e.55384847-8b00-4927-805d-e5a9dca195d0" returned: 0 in 0.273s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-55384847-8b00-4927-805d-e5a9dca195d0" released by "_delete_snapshot" :: held 1.485s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-2a43100d-f96c-4be5-a72d-51ff92a5120e" released by "delete_snapshot" :: held 1.507s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:40 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec 1G" returned: 0 in 0.412s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6acf0540-6521-474d-8bff-99474148ce82 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:40 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6acf0540-6521-474d-8bff-99474148ce82 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec Sep 08 07:40:40 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:40 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Created reservations ['042ee2e4-9241-4cf8-841f-4f7f23eda4e8', '2880b218-f3b5-46ab-8ebf-d8e05d2d090c', 'f8e724a9-2230-4c56-851e-5259fd6feda7', 'da5365b7-7419-4979-a050-184aaf319e61'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:40 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Delete snapshot completed successfully. Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-22fa4f63-0cdc-44d8-aa4e-d3b138a5d709 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-55384847-8b00-4927-805d-e5a9dca195d0-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:41 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6acf0540-6521-474d-8bff-99474148ce82 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec" returned: 0 in 0.289s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:41 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec is being set with open permissions: ugo+rw Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:41 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec Sep 08 07:40:41 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:41 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec" returned: 0 in 0.251s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:41 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.info Sep 08 07:40:41 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-2a43100d-f96c-4be5-a72d-51ff92a5120e-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-2a43100d-f96c-4be5-a72d-51ff92a5120e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-2a43100d-f96c-4be5-a72d-51ff92a5120e" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-2a43100d-f96c-4be5-a72d-51ff92a5120e" acquired by "delete_volume" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d106ce-5448-4c6f-bf16-45fd610e1e36]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:41 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.info" returned: 0 in 0.267s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:41 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.info is being set with open permissions: ugo+rw Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:41 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e Sep 08 07:40:41 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:41 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.info Sep 08 07:40:41 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:41 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.info" returned: 0 in 0.256s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:42 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e" returned: 0 in 0.390s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:42 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e Sep 08 07:40:42 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9bfa81df-2c05-4015-b4cd-5f8bb536300f tempest-ProjectReaderTests-1685362278 None] Create snapshot completed successfully Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-096efa7f-b70d-4bf6-8b00-c57484b0a5ec-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-096efa7f-b70d-4bf6-8b00-c57484b0a5ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-6acf0540-6521-474d-8bff-99474148ce82" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-6acf0540-6521-474d-8bff-99474148ce82" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-096efa7f-b70d-4bf6-8b00-c57484b0a5ec" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-096efa7f-b70d-4bf6-8b00-c57484b0a5ec" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Deleting offline snapshot 096efa7f-b70d-4bf6-8b00-c57484b0a5ec of volume 6acf0540-6521-474d-8bff-99474148ce82 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] snapshot_file for this snap is: volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:42 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-2a43100d-f96c-4be5-a72d-51ff92a5120e" returned: 0 in 0.285s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b729f81f-5bb2-43aa-bbac-acd9f485a357]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-2a43100d-f96c-4be5-a72d-51ff92a5120e" released by "delete_volume" :: held 0.744s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Created reservations ['d409eedd-2a97-4874-bc60-2a59755ad17b', '32c1882e-7839-421c-b24b-e9e10d507880', '36c3b93e-89f4-46f2-bd38-95d48c5365b2', '7ea21153-b070-4a0f-9708-fdd79998cdf0'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:42 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec Sep 08 07:40:42 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:42 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:42 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:42 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec" returned: 0 in 0.398s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6acf0540-6521-474d-8bff-99474148ce82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d790ea5e-a0f4-42e8-b1cd-afc8a7382eca]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:42 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.296s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Deleted volume successfully. Sep 08 07:40:42 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-8553f9f9-083c-4f28-bc51-22bc779d0c79 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-2a43100d-f96c-4be5-a72d-51ff92a5120e-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:42 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 Sep 08 07:40:42 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:43 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82" returned: 0 in 0.383s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:43 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec Sep 08 07:40:43 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (af6c2d98-9e3c-45dd-95c3-0bc5231d77c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0675fbba-3728-45ae-93e8-8b84943ca53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0675fbba-3728-45ae-93e8-8b84943ca53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689585553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c2ed3c-f8b1-47b8-9305-7dc32395e8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:43Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eb82e8-f9d1-4774-916b-95322d1fbfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eb82e8-f9d1-4774-916b-95322d1fbfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73046567-a6c4-4854-b045-f09ade2825b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73046567-a6c4-4854-b045-f09ade2825b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c2ed3c-f8b1-47b8-9305-7dc32395e8ca', 'volume_name': 'volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eaca306-45bb-4761-aa7a-effbcc2898ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eaca306-45bb-4761-aa7a-effbcc2898ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60b2540-b10d-40ba-8483-5c595e1b14b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:43 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Volume 36c2ed3c-f8b1-47b8-9305-7dc32395e8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca', 'volume_size': 1} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689585553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c2ed3c-f8b1-47b8-9305-7dc32395e8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:43Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Creating volume 36c2ed3c-f8b1-47b8-9305-7dc32395e8ca {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:43 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:43 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca 1073741824 Sep 08 07:40:43 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:43 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec" returned: 0 in 0.318s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:43 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec Sep 08 07:40:43 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:43 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca 1073741824" returned: 0 in 0.422s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:43 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82.096efa7f-b70d-4bf6-8b00-c57484b0a5ec" returned: 0 in 0.274s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:43 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca Sep 08 07:40:43 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-096efa7f-b70d-4bf6-8b00-c57484b0a5ec" released by "_delete_snapshot" :: held 1.487s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-6acf0540-6521-474d-8bff-99474148ce82" released by "delete_snapshot" :: held 1.513s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Created reservations ['df0f019f-bc43-4e53-b406-e1d836bbdcd2', '598a7aa8-bff9-4a87-a047-0dde15a713be', '70239b06-6f0a-4f8e-892f-8a3b8d8c34ce', '1ed8a916-5dd4-4804-a6a0-21c37222b1af'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:43 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Delete snapshot completed successfully. Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-9d5d0a28-8556-45c4-a03d-38581214c99b tempest-ProjectReaderTests-1685362278 None] Lock "cinder-096efa7f-b70d-4bf6-8b00-c57484b0a5ec-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:43 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" returned: 0 in 0.274s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60b2540-b10d-40ba-8483-5c595e1b14b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:43 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee7f206-6ba4-4edc-b78c-eadcb1ba14c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:44 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Volume volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca (36c2ed3c-f8b1-47b8-9305-7dc32395e8ca): created successfully Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee7f206-6ba4-4edc-b78c-eadcb1ba14c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (af6c2d98-9e3c-45dd-95c3-0bc5231d77c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:44 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1c991034-c193-497e-9975-9297c9f7bc3a tempest-ProjectMemberTests-1654685749 None] Created volume successfully. Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Creating offline snapshot f79ad429-a405-41af-9271-329f84ab8f1e of volume 36c2ed3c-f8b1-47b8-9305-7dc32395e8ca {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7564bd95-df4c-4f48-989b-5e748c892f8c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-6acf0540-6521-474d-8bff-99474148ce82-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Lock "cinder-6acf0540-6521-474d-8bff-99474148ce82-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-6acf0540-6521-474d-8bff-99474148ce82" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-6acf0540-6521-474d-8bff-99474148ce82" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:44 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca Sep 08 07:40:44 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c0e6ff-f3a8-4280-8d0c-c1bb2fe4592d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:44 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 Sep 08 07:40:44 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:44 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:44 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:44 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" returned: 0 in 0.398s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:44 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e 1G Sep 08 07:40:44 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:44 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82" returned: 0 in 0.360s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:44 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82 Sep 08 07:40:44 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:44 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.278s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:40:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:40:45 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-6acf0540-6521-474d-8bff-99474148ce82" returned: 0 in 0.285s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-6acf0540-6521-474d-8bff-99474148ce82" released by "delete_volume" :: held 0.710s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:45 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e 1G" returned: 0 in 0.427s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:45 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e Sep 08 07:40:45 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Created reservations ['74b7a57e-1299-4c87-97c8-b7effd981357', '17a88ca6-c32e-4092-b552-aaa6579bae7b', 'aa61ff0c-22db-419d-8e3c-c1c7777510d8', 'a27d4412-3e13-4ff2-8e17-3f04bc8f5bfc'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:45 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:45 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:45 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e" returned: 0 in 0.301s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:45 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e is being set with open permissions: ugo+rw Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:45 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e Sep 08 07:40:45 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:45 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.264s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:45 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Deleted volume successfully. Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-df986119-a931-4a76-90f9-36d0b61309ca tempest-ProjectReaderTests-1685362278 None] Lock "cinder-6acf0540-6521-474d-8bff-99474148ce82-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:45 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e" returned: 0 in 0.268s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:45 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.info Sep 08 07:40:45 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:46 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (bb91709e-9d13-4f62-97b4-cd599ea337a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dcc8cc-a490-43f8-ad8d-1385a768e6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.info" returned: 0 in 0.280s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:46 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.info is being set with open permissions: ugo+rw Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:46 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.info Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dcc8cc-a490-43f8-ad8d-1385a768e6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288720149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb546b1c-fa6a-4dfb-a28a-70b7c8af9087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:46Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:46 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147d95e8-6e48-493f-a1e6-fb81a4f3f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147d95e8-6e48-493f-a1e6-fb81a4f3f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5237fa0-5480-415c-8432-41c1f9faa89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5237fa0-5480-415c-8432-41c1f9faa89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb546b1c-fa6a-4dfb-a28a-70b7c8af9087', 'volume_name': 'volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a4b6bc-5ad5-46a8-ad3b-80913b30e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a4b6bc-5ad5-46a8-ad3b-80913b30e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35ef983-ae42-45a7-9b76-f0a299df5a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:46 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Volume bb546b1c-fa6a-4dfb-a28a-70b7c8af9087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087', 'volume_size': 1} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:46 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.info" returned: 0 in 0.249s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288720149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb546b1c-fa6a-4dfb-a28a-70b7c8af9087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ecf678a7f8440987d0b9784dce0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:46Z,use_quota=True,user_id='7a38b82fdec44b469a69d14e32811220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Creating volume bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:46 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:46 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 1073741824 Sep 08 07:40:46 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:46 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a42c238a-cb7f-441c-a732-82142c7501f2 tempest-ProjectMemberTests-1654685749 None] Create snapshot completed successfully Sep 08 07:40:46 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 1073741824" returned: 0 in 0.397s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:46 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 Sep 08 07:40:46 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:46 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" returned: 0 in 0.251s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35ef983-ae42-45a7-9b76-f0a299df5a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd41f62-7f5f-4577-8f4d-60bb480291a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:47 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Volume volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 (bb546b1c-fa6a-4dfb-a28a-70b7c8af9087): created successfully Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd41f62-7f5f-4577-8f4d-60bb480291a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Flow 'volume_create_manager' (bb91709e-9d13-4f62-97b4-cd599ea337a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:47 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-f33430fb-90c7-474f-a3d3-c577ef759694 tempest-ProjectReaderTests-1685362278 None] Created volume successfully. Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-f79ad429-a405-41af-9271-329f84ab8f1e-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-f79ad429-a405-41af-9271-329f84ab8f1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-f79ad429-a405-41af-9271-329f84ab8f1e" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-f79ad429-a405-41af-9271-329f84ab8f1e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Deleting offline snapshot f79ad429-a405-41af-9271-329f84ab8f1e of volume 36c2ed3c-f8b1-47b8-9305-7dc32395e8ca {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] snapshot_file for this snap is: volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e856f-2240-4d63-8c0c-8379103e3c7d]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:47 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e Sep 08 07:40:47 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:47 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e" returned: 0 in 0.351s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fad05f-6143-458e-ab85-eb32b774d089]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:47 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:48 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca Sep 08 07:40:48 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Creating offline snapshot 0cbbb054-f7dd-42cd-b0c6-cb377a40d106 of volume bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c8752-dad7-48ca-9e40-0ce47e3c4c47]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:48 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" returned: 0 in 0.383s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:48 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e Sep 08 07:40:48 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:48 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 Sep 08 07:40:48 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:48 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" returned: 0 in 0.354s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:48 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e" returned: 0 in 0.340s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:48 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 1G Sep 08 07:40:48 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:48 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e Sep 08 07:40:48 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:48 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca.f79ad429-a405-41af-9271-329f84ab8f1e" returned: 0 in 0.258s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-f79ad429-a405-41af-9271-329f84ab8f1e" released by "_delete_snapshot" :: held 1.420s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" released by "delete_snapshot" :: held 1.440s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:48 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Created reservations ['59a316c5-82f4-4227-aade-ad5472899488', 'e6cfaf31-33f6-45dc-89a4-63d68370789d', '207f0472-6487-4aa0-a4cb-a5de99675995', '1951dd72-5552-45ab-9562-27bfb9021fb3'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:49 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:49 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Delete snapshot completed successfully. Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 1G" returned: 0 in 0.422s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c3a72349-efca-4741-abe0-6f8cad4982a9 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-f79ad429-a405-41af-9271-329f84ab8f1e-delete_snapshot" released by "delete_snapshot" :: held 1.586s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:49 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 Sep 08 07:40:49 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:49 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106" returned: 0 in 0.288s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:49 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 is being set with open permissions: ugo+rw Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:49 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 Sep 08 07:40:49 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:49 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106" returned: 0 in 0.245s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:49 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.info Sep 08 07:40:49 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" acquired by "delete_volume" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e778ec-b08a-4422-b9c5-f46c0929d3ab]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:49 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.info" returned: 0 in 0.265s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:49 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.info is being set with open permissions: ugo+rw Sep 08 07:40:49 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:49 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.info Sep 08 07:40:49 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:49 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca Sep 08 07:40:49 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:50 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.info" returned: 0 in 0.248s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:50 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" returned: 0 in 0.364s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:50 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-5ef2d04f-7f7a-47b9-9388-c0fbcf73b0e1 tempest-ProjectReaderTests-1685362278 None] Create snapshot completed successfully Sep 08 07:40:50 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca Sep 08 07:40:50 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-0cbbb054-f7dd-42cd-b0c6-cb377a40d106-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-0cbbb054-f7dd-42cd-b0c6-cb377a40d106-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-0cbbb054-f7dd-42cd-b0c6-cb377a40d106" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:50 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-0cbbb054-f7dd-42cd-b0c6-cb377a40d106" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Deleting offline snapshot 0cbbb054-f7dd-42cd-b0c6-cb377a40d106 of volume bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] snapshot_file for this snap is: volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" returned: 0 in 0.282s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[924090f9-5c44-47e1-b595-90dce38d9eaf]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca" released by "delete_volume" :: held 0.712s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Created reservations ['712391cb-d7f6-410b-81d5-c5e1b5f266a2', 'd0bd828d-5a37-4cad-917c-5589459e9fa3', 'baf8ba0d-7c64-4543-9385-e1ec2a41f496', '39d4a916-8da5-495c-98cd-cf2fdd365889'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:50 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 Sep 08 07:40:50 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:50 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:50 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:50 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:50 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106" returned: 0 in 0.391s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.283s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:50 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Deleted volume successfully. Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[98780198-a113-4c76-9482-1b6ce679aa33]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c5063cbb-d2c0-48fb-b536-6117efc34b47 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-36c2ed3c-f8b1-47b8-9305-7dc32395e8ca-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:50 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 Sep 08 07:40:50 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:51 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" returned: 0 in 0.383s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:51 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 Sep 08 07:40:51 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (3fec5c94-d73f-4a7c-8ee4-c3d2b23e2eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcccc3d-9b49-4226-a58b-769c7acb6a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcccc3d-9b49-4226-a58b-769c7acb6a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-583309085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11a1082-9ff6-4100-9f32-9dbf551e8e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:51Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8654dc1-d945-4dbf-aa4a-3e8270d87216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8654dc1-d945-4dbf-aa4a-3e8270d87216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9c9cdc-bc9d-4575-9664-07977348f113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9c9cdc-bc9d-4575-9664-07977348f113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11a1082-9ff6-4100-9f32-9dbf551e8e2c', 'volume_name': 'volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0592e0-940f-4093-9f97-13025e0cafbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0592e0-940f-4093-9f97-13025e0cafbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14cf92ce-0be8-4666-97a6-22ad9eb8cb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:51 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Volume c11a1082-9ff6-4100-9f32-9dbf551e8e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c', 'volume_size': 1} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-583309085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11a1082-9ff6-4100-9f32-9dbf551e8e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:51Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Creating volume c11a1082-9ff6-4100-9f32-9dbf551e8e2c {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:51 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:51 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c 1073741824 Sep 08 07:40:51 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:51 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106" returned: 0 in 0.365s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:51 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106 Sep 08 07:40:51 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:51 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c 1073741824" returned: 0 in 0.426s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:51 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c Sep 08 07:40:51 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:51 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087.0cbbb054-f7dd-42cd-b0c6-cb377a40d106" returned: 0 in 0.255s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-0cbbb054-f7dd-42cd-b0c6-cb377a40d106" released by "_delete_snapshot" :: held 1.493s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" released by "delete_snapshot" :: held 1.514s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:51 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Created reservations ['e5f2c2f7-e3c6-4f24-a4c2-9ffaf628ffb3', 'bf526451-88e4-4b38-b333-e4690fd68b14', '3abcb96b-bd66-4a6c-94cc-fe5cbb17cbaf', '7566d8c7-7b9c-41cb-b217-84b634b1c933'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:52 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Delete snapshot completed successfully. Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-095488d9-3e3e-4d4d-a904-6a2dace76591 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-0cbbb054-f7dd-42cd-b0c6-cb377a40d106-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:52 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" returned: 0 in 0.264s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14cf92ce-0be8-4666-97a6-22ad9eb8cb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8c751c-4295-45a1-a9f7-ff6b0e35f6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:52 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Volume volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c (c11a1082-9ff6-4100-9f32-9dbf551e8e2c): created successfully Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8c751c-4295-45a1-a9f7-ff6b0e35f6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (3fec5c94-d73f-4a7c-8ee4-c3d2b23e2eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:52 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-00f0bc0d-8103-4ecf-bf03-db48db702127 tempest-ProjectMemberTests-1654685749 None] Created volume successfully. Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Creating offline snapshot c8b7e12d-7e67-43e0-bccd-35ae0969aa03 of volume c11a1082-9ff6-4100-9f32-9dbf551e8e2c {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d401332-f945-440f-b6c2-7ad274333e01]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:52 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c Sep 08 07:40:52 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "cinder-quobyte-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6123b70-1c49-4185-b872-f485efc3fb0c]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:52 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 Sep 08 07:40:52 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:52 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" returned: 0 in 0.358s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:52 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 1G Sep 08 07:40:52 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:53 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" returned: 0 in 0.407s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:53 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087 Sep 08 07:40:53 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:53 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 1G" returned: 0 in 0.415s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:53 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 Sep 08 07:40:53 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:53 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" returned: 0 in 0.266s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-quobyte-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087" released by "delete_volume" :: held 0.729s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Created reservations ['6c40ec3c-6d77-4d73-b323-c88919a3f02b', '354dfdfa-4b97-45b0-a465-4d4becee58e6', 'fc696444-a412-4dba-a933-77c0db4478d2', '82e25dbb-5ae5-4de2-89d8-8f300bc2cb99'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:53 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:53 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:53 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03" returned: 0 in 0.305s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:53 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 is being set with open permissions: ugo+rw Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:53 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 Sep 08 07:40:53 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:53 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.275s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:53 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Deleted volume successfully. Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a18ec9a9-23f9-45cd-8fbc-77521d0180e1 tempest-ProjectReaderTests-1685362278 None] Lock "cinder-bb546b1c-fa6a-4dfb-a28a-70b7c8af9087-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:53 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03" returned: 0 in 0.265s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:53 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.info Sep 08 07:40:53 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:54 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.info" returned: 0 in 0.274s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:54 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.info is being set with open permissions: ugo+rw Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:54 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.info Sep 08 07:40:54 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:54 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.info" returned: 0 in 0.257s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:54 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-91aed37a-1e55-4557-8735-b6051b94582b tempest-ProjectMemberTests-1654685749 None] Create snapshot completed successfully Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-c8b7e12d-7e67-43e0-bccd-35ae0969aa03-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-c8b7e12d-7e67-43e0-bccd-35ae0969aa03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-c8b7e12d-7e67-43e0-bccd-35ae0969aa03" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-c8b7e12d-7e67-43e0-bccd-35ae0969aa03" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Deleting offline snapshot c8b7e12d-7e67-43e0-bccd-35ae0969aa03 of volume c11a1082-9ff6-4100-9f32-9dbf551e8e2c {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] snapshot_file for this snap is: volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f72ddfd-a480-42da-acdd-cff50c95ddee]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:54 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 Sep 08 07:40:54 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:55 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03" returned: 0 in 0.403s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:55 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:40:55 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e907c8-239f-4fc3-aa7a-c90ead93d9e3]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:55 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c Sep 08 07:40:55 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:55 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" returned: 0 in 0.377s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:55 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 Sep 08 07:40:55 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:55 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03" returned: 0 in 0.367s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:55 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03 Sep 08 07:40:55 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:56 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c.c8b7e12d-7e67-43e0-bccd-35ae0969aa03" returned: 0 in 0.275s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-c8b7e12d-7e67-43e0-bccd-35ae0969aa03" released by "_delete_snapshot" :: held 1.518s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" released by "delete_snapshot" :: held 1.543s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Created reservations ['65a50819-0edf-4a7d-b01f-c348af3c253b', 'dddd56b9-2609-4aff-903e-91116b43e4b3', 'f0f91e5a-103b-448b-8f82-a9e84e4f3f9f', '40ea08f4-030b-4da2-a04b-bfeb57a2b81a'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:56 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Delete snapshot completed successfully. Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-886e0c7e-3069-46e5-a33e-0160a840d578 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-c8b7e12d-7e67-43e0-bccd-35ae0969aa03-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-c11a1082-9ff6-4100-9f32-9dbf551e8e2c-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-c11a1082-9ff6-4100-9f32-9dbf551e8e2c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" acquired by "delete_volume" :: waited 0.013s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed05574-40a7-49c8-a98f-d26ef87ff5e8]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:56 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:56 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c Sep 08 07:40:56 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:57 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" returned: 0 in 0.374s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:57 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c Sep 08 07:40:57 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:57 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-c11a1082-9ff6-4100-9f32-9dbf551e8e2c" released by "delete_volume" :: held 0.685s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Created reservations ['80caf5b3-c191-4aeb-99be-21d7c2d2813a', 'f0e2c6e9-c2f0-408c-b58e-0d00574c0698', 'eb00bdbc-cf66-4636-a654-a6793e65320d', '7524f475-2ca0-4ae8-830a-bba59af0f97d'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:57 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:40:57 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:57 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.260s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:40:57 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Deleted volume successfully. Sep 08 07:40:57 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6bf0d74a-47fc-4f80-b35a-dc5083802ef8 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-c11a1082-9ff6-4100-9f32-9dbf551e8e2c-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (b61b3f89-bdf4-42a2-a920-9bb42850d2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d7255e-683b-40e3-838f-5f0f2a88c9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d7255e-683b-40e3-838f-5f0f2a88c9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143228264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64d72e6-75cd-471d-8614-c0969312988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:58Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78cbc0f-e496-4eff-82c2-06c984ce8acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78cbc0f-e496-4eff-82c2-06c984ce8acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65213fcf-09b6-4ada-81e9-7bbbe792baed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65213fcf-09b6-4ada-81e9-7bbbe792baed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64d72e6-75cd-471d-8614-c0969312988b', 'volume_name': 'volume-b64d72e6-75cd-471d-8614-c0969312988b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b91b7ab-ba1a-4e40-ab11-58479b7c9d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b91b7ab-ba1a-4e40-ab11-58479b7c9d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfff10fc-a82f-4a9f-b684-1d40d6c5e8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:58 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Volume b64d72e6-75cd-471d-8614-c0969312988b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64d72e6-75cd-471d-8614-c0969312988b', 'volume_size': 1} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143228264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64d72e6-75cd-471d-8614-c0969312988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b531e0b5f6c47c6b6f3ed3a3058483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:40:58Z,use_quota=True,user_id='af0b9179790f44a5a8d92a0aeb2d05c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Creating volume b64d72e6-75cd-471d-8614-c0969312988b {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:40:58 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:58 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b 1073741824 Sep 08 07:40:58 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:58 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b 1073741824" returned: 0 in 0.449s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:58 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:58 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b Sep 08 07:40:58 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:59 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b" returned: 0 in 0.260s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfff10fc-a82f-4a9f-b684-1d40d6c5e8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64d72e6-75cd-471d-8614-c0969312988b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f71473-b53d-4ac5-a0d3-2c9643ffdef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:40:59 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Volume volume-b64d72e6-75cd-471d-8614-c0969312988b (b64d72e6-75cd-471d-8614-c0969312988b): created successfully Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f71473-b53d-4ac5-a0d3-2c9643ffdef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Flow 'volume_create_manager' (b61b3f89-bdf4-42a2-a920-9bb42850d2dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:40:59 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-23d357e2-b747-4c73-9061-8d96144609e9 tempest-ProjectMemberTests-1654685749 None] Created volume successfully. Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Creating offline snapshot c346161c-464b-4dfe-a8a7-d373e68962f5 of volume b64d72e6-75cd-471d-8614-c0969312988b {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0048c978-625b-431a-b23b-857835175e14]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:40:59 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:40:59 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b Sep 08 07:40:59 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:40:59 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b" returned: 0 in 0.359s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:00 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 1G Sep 08 07:41:00 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:00 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 1G" returned: 0 in 0.376s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64d72e6-75cd-471d-8614-c0969312988b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:00 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64d72e6-75cd-471d-8614-c0969312988b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 Sep 08 07:41:00 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:00 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64d72e6-75cd-471d-8614-c0969312988b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5" returned: 0 in 0.300s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:00 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 is being set with open permissions: ugo+rw Sep 08 07:41:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:00 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 Sep 08 07:41:00 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:00 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5" returned: 0 in 0.254s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:00 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:00 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.info Sep 08 07:41:00 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:01 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.info" returned: 0 in 0.276s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:01 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.info is being set with open permissions: ugo+rw Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:01 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.info Sep 08 07:41:01 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:01 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.info" returned: 0 in 0.267s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:01 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-fcc5c445-8dde-42b3-aadc-514f652405f3 tempest-ProjectMemberTests-1654685749 None] Create snapshot completed successfully Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-c346161c-464b-4dfe-a8a7-d373e68962f5-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-c346161c-464b-4dfe-a8a7-d373e68962f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-b64d72e6-75cd-471d-8614-c0969312988b" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-b64d72e6-75cd-471d-8614-c0969312988b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-c346161c-464b-4dfe-a8a7-d373e68962f5" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-c346161c-464b-4dfe-a8a7-d373e68962f5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Deleting offline snapshot c346161c-464b-4dfe-a8a7-d373e68962f5 of volume b64d72e6-75cd-471d-8614-c0969312988b {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] snapshot_file for this snap is: volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c3fbd2-74a5-44c6-a86e-f668f30f610a]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:01 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:01 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 Sep 08 07:41:01 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:02 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5" returned: 0 in 0.354s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:02 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b64d72e6-75cd-471d-8614-c0969312988b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:41:02 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2c2384-3141-4aaa-8021-b0a841c2d261]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:02 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b Sep 08 07:41:02 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:02 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b" returned: 0 in 0.375s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:02 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 Sep 08 07:41:02 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:02 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5" returned: 0 in 0.358s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:02 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:03 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5 Sep 08 07:41:03 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:03 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:03 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b.c346161c-464b-4dfe-a8a7-d373e68962f5" returned: 0 in 0.258s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-c346161c-464b-4dfe-a8a7-d373e68962f5" released by "_delete_snapshot" :: held 1.439s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-b64d72e6-75cd-471d-8614-c0969312988b" released by "delete_snapshot" :: held 1.463s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:03 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Created reservations ['8d6b1bb5-ed10-427f-840a-333a50ca2c56', '8db17f27-e16c-48d5-a152-d503c5a8fff5', '0e846b29-e928-4ead-8f81-3dfa3529fd1b', '932e1382-4a75-4653-9dc3-3cf63f9b500f'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:41:03 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Delete snapshot completed successfully. Sep 08 07:41:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-0bdf76b0-e1e4-42c0-99ec-9dcb55e86e59 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-c346161c-464b-4dfe-a8a7-d373e68962f5-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-b64d72e6-75cd-471d-8614-c0969312988b-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:03 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-b64d72e6-75cd-471d-8614-c0969312988b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "cinder-quobyte-b64d72e6-75cd-471d-8614-c0969312988b" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-b64d72e6-75cd-471d-8614-c0969312988b" acquired by "delete_volume" :: waited 0.019s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[040f7a46-f35c-4359-bc01-d69cf63d3d71]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:04 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b Sep 08 07:41:04 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:04 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b" returned: 0 in 0.360s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:04 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b Sep 08 07:41:04 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:04 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b64d72e6-75cd-471d-8614-c0969312988b" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-quobyte-b64d72e6-75cd-471d-8614-c0969312988b" released by "delete_volume" :: held 0.672s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Created reservations ['c5707072-c276-4288-b08f-9bc435b1b48d', '68e5537e-f6cd-40c2-9f8b-cb839a337752', '83fa434f-b1fd-4490-ac1c-ec6bc63567dc', '0827329a-327a-4b18-bcd9-2543915aacec'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:04 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:04 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:41:04 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:05 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:05 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.270s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:05 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:41:05 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Deleted volume successfully. Sep 08 07:41:05 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-a9a39fea-1421-4c71-b34f-166d465d7708 tempest-ProjectMemberTests-1654685749 None] Lock "cinder-b64d72e6-75cd-471d-8614-c0969312988b-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:14 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=191,cinder:UPDATE=267,cinder:INSERT=73,cinder:DELETE=19 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:41:14 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=192,cinder:INSERT=67,cinder:DELETE=22,cinder:UPDATE=243 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Flow 'volume_create_manager' (2a6e5df2-e724-4d90-9ad5-01c1fe9c452f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61ce1f7-c42a-4fc2-a789-2aa0f6104d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61ce1f7-c42a-4fc2-a789-2aa0f6104d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456741163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee164df-298d-4bb7-b48e-c1edfbb4a5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695cd2447053494b8fb5f9f583797c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:41:17Z,use_quota=True,user_id='18bc99db46a84b64ad1f5e2f24bfe4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b5b0f9-08ea-4a63-8dc5-f4924c701a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b5b0f9-08ea-4a63-8dc5-f4924c701a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa45293-1c7e-40a1-9e8d-d457d1e7f77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa45293-1c7e-40a1-9e8d-d457d1e7f77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee164df-298d-4bb7-b48e-c1edfbb4a5d2', 'volume_name': 'volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f4831c-e3ab-449a-9c17-228a618b2102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f4831c-e3ab-449a-9c17-228a618b2102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20fe0f6-43e5-468b-8f12-e6620e5433b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:17 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Volume 7ee164df-298d-4bb7-b48e-c1edfbb4a5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2', 'volume_size': 1} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456741163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee164df-298d-4bb7-b48e-c1edfbb4a5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695cd2447053494b8fb5f9f583797c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:41:17Z,use_quota=True,user_id='18bc99db46a84b64ad1f5e2f24bfe4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Creating volume 7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:41:17 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:17 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 1073741824 Sep 08 07:41:17 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:17 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 1073741824" returned: 0 in 0.422s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:17 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:17 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 Sep 08 07:41:17 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:18 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2" returned: 0 in 0.243s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20fe0f6-43e5-468b-8f12-e6620e5433b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ef56ba-b39c-446e-b237-48dabb32853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:18 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Volume volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 (7ee164df-298d-4bb7-b48e-c1edfbb4a5d2): created successfully Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ef56ba-b39c-446e-b237-48dabb32853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Flow 'volume_create_manager' (2a6e5df2-e724-4d90-9ad5-01c1fe9c452f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:41:18 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-a5b7866d-5623-44a0-80ee-765bd3665f2e tempest-ProjectReaderTests-1725559329 None] Created volume successfully. Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Acquiring lock "cinder-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Lock "cinder-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Acquiring lock "cinder-quobyte-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Lock "cinder-quobyte-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2" acquired by "delete_volume" :: waited 0.013s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46f443b-9903-4d6b-8310-db34f73346fd]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:18 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:18 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 Sep 08 07:41:18 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:19 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2" returned: 0 in 0.355s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:19 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2 Sep 08 07:41:19 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:19 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2" returned: 0 in 0.235s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Lock "cinder-quobyte-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2" released by "delete_volume" :: held 0.624s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Created reservations ['b8504035-aaea-4f1d-bb78-5ed2dfd0434c', '08518fbb-1509-4d46-9741-9156fb581de1', '47159f26-3c60-44ce-9c3b-a3d3217a0946', '6982fa02-298e-4793-82a2-cb78920795ca'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:19 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:41:19 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:19 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.244s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:41:19 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Deleted volume successfully. Sep 08 07:41:19 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-c0a65396-c7ee-44ab-a19a-133311e2c09e tempest-ProjectReaderTests-1725559329 None] Lock "cinder-7ee164df-298d-4bb7-b48e-c1edfbb4a5d2-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Flow 'volume_create_manager' (71228bdc-f846-4430-bba2-cdbe4b0a0c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c0419b-c52e-4fe5-acc7-ff5e4c59c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c0419b-c52e-4fe5-acc7-ff5e4c59c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168765969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b644063-dc4a-4c70-8587-394a6f50a08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695cd2447053494b8fb5f9f583797c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:41:20Z,use_quota=True,user_id='18bc99db46a84b64ad1f5e2f24bfe4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d14b0fb-bd33-4ba6-8822-1ac37722b43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d14b0fb-bd33-4ba6-8822-1ac37722b43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeba8428-aa8b-44d5-9a49-011cad251260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeba8428-aa8b-44d5-9a49-011cad251260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b644063-dc4a-4c70-8587-394a6f50a08d', 'volume_name': 'volume-9b644063-dc4a-4c70-8587-394a6f50a08d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788d5c71-3aa3-40f6-bbb2-d5be26f9d605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788d5c71-3aa3-40f6-bbb2-d5be26f9d605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ab0728-02be-4af9-8dde-2f9c162c2e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:20 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Volume 9b644063-dc4a-4c70-8587-394a6f50a08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b644063-dc4a-4c70-8587-394a6f50a08d', 'volume_size': 1} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168765969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b644063-dc4a-4c70-8587-394a6f50a08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695cd2447053494b8fb5f9f583797c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:41:20Z,use_quota=True,user_id='18bc99db46a84b64ad1f5e2f24bfe4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Creating volume 9b644063-dc4a-4c70-8587-394a6f50a08d {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:41:20 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:20 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d 1073741824 Sep 08 07:41:20 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:20 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d 1073741824" returned: 0 in 0.392s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:20 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d Sep 08 07:41:20 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:20 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d" returned: 0 in 0.250s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ab0728-02be-4af9-8dde-2f9c162c2e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b644063-dc4a-4c70-8587-394a6f50a08d', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68084f2d-b2b8-4327-8a03-14fed8134fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:20 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Volume volume-9b644063-dc4a-4c70-8587-394a6f50a08d (9b644063-dc4a-4c70-8587-394a6f50a08d): created successfully Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68084f2d-b2b8-4327-8a03-14fed8134fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:20 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Flow 'volume_create_manager' (71228bdc-f846-4430-bba2-cdbe4b0a0c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:41:20 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-289a8b31-cb0d-4b18-8b95-07f1f49b1936 tempest-ProjectReaderTests-1725559329 None] Created volume successfully. Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Acquiring lock "cinder-9b644063-dc4a-4c70-8587-394a6f50a08d-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Lock "cinder-9b644063-dc4a-4c70-8587-394a6f50a08d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Acquiring lock "cinder-quobyte-9b644063-dc4a-4c70-8587-394a6f50a08d" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Lock "cinder-quobyte-9b644063-dc4a-4c70-8587-394a6f50a08d" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06d3f33-8d53-4969-863b-5b0b9d3918eb]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:21 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d Sep 08 07:41:21 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:21 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d" returned: 0 in 0.335s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:21 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d Sep 08 07:41:21 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:21 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-9b644063-dc4a-4c70-8587-394a6f50a08d" returned: 0 in 0.253s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Lock "cinder-quobyte-9b644063-dc4a-4c70-8587-394a6f50a08d" released by "delete_volume" :: held 0.625s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:21 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Created reservations ['66110077-aabd-4c7a-b2d0-184e06b33999', 'e145e722-82f5-4a65-af0f-7d6e58f506da', '3d4bcb96-befc-4ab0-859f-451487db0138', '97ce2d0e-7764-4c36-b228-3839aef00d6a'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:41:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:22 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:22 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:41:22 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:22 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:22 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.231s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:22 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:41:22 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Deleted volume successfully. Sep 08 07:41:22 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6cddc9c1-2ada-42c0-b323-f50e067d89e6 tempest-ProjectReaderTests-1725559329 None] Lock "cinder-9b644063-dc4a-4c70-8587-394a6f50a08d-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:32 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:UPDATE=24,cinder:SELECT=10,cinder:INSERT=5 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:41:32 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=18,cinder:UPDATE=20,cinder:DELETE=4,cinder:INSERT=5 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Flow 'volume_create_manager' (96f64f8f-b49d-44fb-9728-d9cd8122a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bcb1d6b-7241-4be9-9237-3ef87daef6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bcb1d6b-7241-4be9-9237-3ef87daef6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1612166373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f9d4cb-3204-4001-9b9c-359ae2b4735b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c9ab2ba3884fdb920b98dbfab17f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:41:41Z,use_quota=True,user_id='f9728600bad54991a5d00f4558583796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a7b699-5a1d-4791-a93a-a11c54bedf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a7b699-5a1d-4791-a93a-a11c54bedf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2edbcc0-a466-429d-b7ae-692a7d8498b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2edbcc0-a466-429d-b7ae-692a7d8498b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f9d4cb-3204-4001-9b9c-359ae2b4735b', 'volume_name': 'volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5806b176-94d6-40eb-a623-e00643019477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5806b176-94d6-40eb-a623-e00643019477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc9ce3d-8958-41e5-bc6c-1442cfca823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:41 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Volume a6f9d4cb-3204-4001-9b9c-359ae2b4735b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b', 'volume_size': 1} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1612166373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f9d4cb-3204-4001-9b9c-359ae2b4735b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c9ab2ba3884fdb920b98dbfab17f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:41:41Z,use_quota=True,user_id='f9728600bad54991a5d00f4558583796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)}" {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Creating volume a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:41:41 devstack cinder-volume[87278]: INFO cinder.volume.drivers.remotefs [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] casted to osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b 1073741824 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:41 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b 1073741824 Sep 08 07:41:41 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:41 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b 1073741824" returned: 0 in 0.416s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:41 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:41 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b Sep 08 07:41:41 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:42 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" returned: 0 in 0.246s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'} {{(pid=87278) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc9ce3d-8958-41e5-bc6c-1442cfca823e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b', 'volume_size': 1}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c98b3-b77c-41b2-ae60-1df39f6d1f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:42 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Volume volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b (a6f9d4cb-3204-4001-9b9c-359ae2b4735b): created successfully Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c98b3-b77c-41b2-ae60-1df39f6d1f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Flow 'volume_create_manager' (96f64f8f-b49d-44fb-9728-d9cd8122a00b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:41:42 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-d162e5ca-374d-43bc-87b5-c63294cd460b tempest-SnapshotDependencyTests-1042140031 None] Created volume successfully. Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Creating offline snapshot b95d4ffe-b2ba-40db-9de8-09fab99fc062 of volume a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1ee7ad-2c03-4242-b9e9-9c29a1474872]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:42 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b Sep 08 07:41:42 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:42 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" returned: 0 in 0.369s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:42 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 1G {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:43 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 1G Sep 08 07:41:43 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:43 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 1G" returned: 0 in 0.377s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:43 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 Sep 08 07:41:43 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:43 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b -F qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062" returned: 0 in 0.284s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:43 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 is being set with open permissions: ugo+rw Sep 08 07:41:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:43 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 Sep 08 07:41:43 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:43 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062" returned: 0 in 0.244s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:43 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:43 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.info Sep 08 07:41:43 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:44 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.info" returned: 0 in 0.240s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:44 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.info is being set with open permissions: ugo+rw Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.info {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:44 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.info Sep 08 07:41:44 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:44 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.info" returned: 0 in 0.234s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:44 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-1dcc5f77-c399-43b0-9f5e-1039e48093e6 tempest-SnapshotDependencyTests-1042140031 None] Create snapshot completed successfully Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-ca878979-a574-4eda-9606-c84320415209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:44 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:41:44 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:44 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-ca878979-a574-4eda-9606-c84320415209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.251s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG oslo_service.periodic_task [None req-ca878979-a574-4eda-9606-c84320415209 None None] Running periodic task VolumeManager._thread_info {{(pid=87278) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread count: 28 {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:41:44 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-ca878979-a574-4eda-9606-c84320415209 None None] thread info: [<_MainThread(MainThread, started 126941121323136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87278) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87278) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Flow 'volume_create_manager' (0a97f42d-6b73-4d42-a59c-ce8f4bef8704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a001d22-3d4e-4594-ac09-15d8f5a62536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a001d22-3d4e-4594-ac09-15d8f5a62536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b628799e-05a5-4caf-a9cd-8ba601b2857c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c9ab2ba3884fdb920b98dbfab17f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b95d4ffe-b2ba-40db-9de8-09fab99fc062,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:41:45Z,use_quota=True,user_id='f9728600bad54991a5d00f4558583796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0582278-fb93-4622-a8d7-48f2c13bc03e),volume_type_id=e0582278-fb93-4622-a8d7-48f2c13bc03e)' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75351ac-ee5a-4d1e-9ec3-375b896bfe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75351ac-ee5a-4d1e-9ec3-375b896bfe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ca49aa-8572-44de-8ff9-a6c7c2185524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ca49aa-8572-44de-8ff9-a6c7c2185524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b628799e-05a5-4caf-a9cd-8ba601b2857c', 'volume_name': 'volume-b628799e-05a5-4caf-a9cd-8ba601b2857c', 'volume_size': 1, 'snapshot_id': 'b95d4ffe-b2ba-40db-9de8-09fab99fc062'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2392cd2c-f453-480d-affe-a609da7ba373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2392cd2c-f453-480d-affe-a609da7ba373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b63c63a-950c-45ee-b708-f26929387e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:45 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Volume b628799e-05a5-4caf-a9cd-8ba601b2857c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b628799e-05a5-4caf-a9cd-8ba601b2857c', 'volume_size': 1, 'snapshot_id': 'b95d4ffe-b2ba-40db-9de8-09fab99fc062'} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "cinder-quobyte-b95d4ffe-b2ba-40db-9de8-09fab99fc062-b628799e-05a5-4caf-a9cd-8ba601b2857c" by "_create_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-b95d4ffe-b2ba-40db-9de8-09fab99fc062-b628799e-05a5-4caf-a9cd-8ba601b2857c" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Creating volume b628799e-05a5-4caf-a9cd-8ba601b2857c from snapshot b95d4ffe-b2ba-40db-9de8-09fab99fc062 {{(pid=87278) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Selected osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622 as target Quobyte volume. {{(pid=87278) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "cinder-quobyte-b628799e-05a5-4caf-a9cd-8ba601b2857c" by "_copy_volume_from_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-b628799e-05a5-4caf-a9cd-8ba601b2857c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] snapshot: b95d4ffe-b2ba-40db-9de8-09fab99fc062, volume: b628799e-05a5-4caf-a9cd-8ba601b2857c, {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[463bfb1d-0e91-4898-9aeb-e6e01a212f25]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:45 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 Sep 08 07:41:45 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:45 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062" returned: 0 in 0.371s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b3c5ac-89e2-41a6-875c-c93441c83710]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:45 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:45 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b Sep 08 07:41:45 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:46 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" returned: 0 in 0.352s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:41:46 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Creating direct copy from snapshot {{(pid=87278) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:41:46 devstack cinder-volume[87278]: DEBUG cinder.utils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Path /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c not found in is_blk_device check {{(pid=87278) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:41:46 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:46 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c Sep 08 07:41:46 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:50 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c" returned: 0 in 4.026s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.image.image_utils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c {{(pid=87278) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:41:50 devstack cinder-volume[87278]: INFO cinder.image.image_utils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Converted 1024.00 MB image at 254.25 MB/s Sep 08 07:41:50 devstack cinder-volume[87278]: WARNING cinder.volume.drivers.remotefs [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c is being set with open permissions: ugo+rw Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:50 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c Sep 08 07:41:50 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:50 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c" returned: 0 in 0.240s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-b628799e-05a5-4caf-a9cd-8ba601b2857c" released by "_copy_volume_from_snapshot" :: held 5.061s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-b95d4ffe-b2ba-40db-9de8-09fab99fc062-b628799e-05a5-4caf-a9cd-8ba601b2857c" released by "_create_volume_from_snapshot" :: held 5.118s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.134s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b63c63a-950c-45ee-b708-f26929387e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b628799e-05a5-4caf-a9cd-8ba601b2857c', 'volume_size': 1, 'snapshot_id': 'b95d4ffe-b2ba-40db-9de8-09fab99fc062'}' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1151e687-ec1c-441a-b64b-7dc5a7c3a126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:41:50 devstack cinder-volume[87278]: INFO cinder.volume.flows.manager.create_volume [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Volume volume-b628799e-05a5-4caf-a9cd-8ba601b2857c (b628799e-05a5-4caf-a9cd-8ba601b2857c): created successfully Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1151e687-ec1c-441a-b64b-7dc5a7c3a126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87278) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Flow 'volume_create_manager' (0a97f42d-6b73-4d42-a59c-ce8f4bef8704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87278) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:41:50 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-92f54010-290f-42dc-9955-9146836f99c7 tempest-SnapshotDependencyTests-1042140031 None] Created volume successfully. Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "cinder-b95d4ffe-b2ba-40db-9de8-09fab99fc062-delete_snapshot" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-b95d4ffe-b2ba-40db-9de8-09fab99fc062-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "cinder-quobyte-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" by "delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "cinder-quobyte-b95d4ffe-b2ba-40db-9de8-09fab99fc062" by "_delete_snapshot" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-b95d4ffe-b2ba-40db-9de8-09fab99fc062" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Deleting offline snapshot b95d4ffe-b2ba-40db-9de8-09fab99fc062 of volume a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] snapshot_file for this snap is: volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 {{(pid=87278) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9072b51-a306-4ad9-a21a-491c2d5f5856]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:50 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:50 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 Sep 08 07:41:50 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:51 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062" returned: 0 in 0.342s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:51 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.remotefs [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87278) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:41:51 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abeff06-80ce-4adb-848d-2de4da82f6ec]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:51 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b Sep 08 07:41:51 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:51 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" returned: 0 in 0.533s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:51 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:51 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 Sep 08 07:41:51 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:52 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062" returned: 0 in 0.318s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:52 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062 Sep 08 07:41:52 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:52 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b.b95d4ffe-b2ba-40db-9de8-09fab99fc062" returned: 0 in 0.242s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-b95d4ffe-b2ba-40db-9de8-09fab99fc062" released by "_delete_snapshot" :: held 1.522s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" released by "delete_snapshot" :: held 1.543s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Created reservations ['4586a311-c510-4349-a41d-bcf9244acecc', 'e177cd7c-b5ef-4b2d-8c99-629c17e0ec5f', 'f6de9f38-ac50-4ab0-a233-b97f6e20849c', '9caa5666-b57d-49d0-8d11-80f50afcb6e4'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:41:52 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Delete snapshot completed successfully. Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-6e6ce953-faec-455d-a882-527163120c36 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-b95d4ffe-b2ba-40db-9de8-09fab99fc062-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "cinder-a6f9d4cb-3204-4001-9b9c-359ae2b4735b-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-a6f9d4cb-3204-4001-9b9c-359ae2b4735b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "cinder-quobyte-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:52 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" acquired by "delete_volume" :: waited 0.013s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ca45c0-7c12-4bb4-9702-ec7749fe9c97]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:53 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b Sep 08 07:41:53 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:53 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" returned: 0 in 0.350s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:53 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b Sep 08 07:41:53 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:53 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" returned: 0 in 0.240s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-a6f9d4cb-3204-4001-9b9c-359ae2b4735b" released by "delete_volume" :: held 0.640s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Created reservations ['96eb32c3-547f-4ce0-b8e4-9698e21a62b4', '94ecb8f7-511f-449b-b9ba-27b1ff2572a4', '719acde0-a768-4ffe-b1c8-4600d7237342', 'f062745d-6bfd-4510-bd6a-bc41c026bb9c'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:53 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:41:53 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:53 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.247s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:41:53 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Deleted volume successfully. Sep 08 07:41:53 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-656cd60b-417d-4ff5-b360-7755f3fefda7 tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-a6f9d4cb-3204-4001-9b9c-359ae2b4735b-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "cinder-b628799e-05a5-4caf-a9cd-8ba601b2857c-delete_volume" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-b628799e-05a5-4caf-a9cd-8ba601b2857c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "cinder-quobyte-b628799e-05a5-4caf-a9cd-8ba601b2857c" by "delete_volume" {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-b628799e-05a5-4caf-a9cd-8ba601b2857c" acquired by "delete_volume" :: waited 0.016s {{(pid=87278) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3a01d9-0a85-4dac-bef4-c4afeb574353]: (4, 'qcow2') {{(pid=89460) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:54 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c Sep 08 07:41:54 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:54 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c" returned: 0 in 0.350s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:54 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c Sep 08 07:41:54 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:54 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc/volume-b628799e-05a5-4caf-a9cd-8ba601b2857c" returned: 0 in 0.242s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-quobyte-b628799e-05a5-4caf-a9cd-8ba601b2857c" released by "delete_volume" :: held 0.627s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG cinder.quota [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Created reservations ['b7712d3c-448e-4ad6-b462-e577214b4f1f', '01b866c5-3eeb-48ac-8a84-404e5c9c860a', 'ad008052-1778-408f-a05a-2ad2ed93e190', 'ce6dcfc4-d1ab-4689-8d79-efb41ff05f20'] {{(pid=87278) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622': None} {{(pid=87278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG cinder.volume.drivers.quobyte [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e82697a3-bb47-4466-a615-cef2098fb622'] {{(pid=87278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.lockutils [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:41:54 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:41:54 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc Sep 08 07:41:54 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:41:55 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Sep 08 07:41:55 devstack cinder-volume[87278]: DEBUG oslo_concurrency.processutils [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f8f18ff4c948f1b457b73f7e4f085bc" returned: 0 in 0.242s {{(pid=87278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:41:55 devstack cinder-volume[87278]: DEBUG cinder.manager [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Notifying Schedulers of capabilities ... {{(pid=87278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:41:55 devstack cinder-volume[87278]: INFO cinder.volume.manager [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Deleted volume successfully. Sep 08 07:41:55 devstack cinder-volume[87278]: DEBUG cinder.coordination [None req-89b801d8-1c36-4da5-97d1-0f1ae96a75cf tempest-SnapshotDependencyTests-1042140031 None] Lock "cinder-b628799e-05a5-4caf-a9cd-8ba601b2857c-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87278) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:42:04 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:42:05 devstack cinder-volume[87278]: DEBUG dbcounter [-] [87278] Writing DB stats cinder:SELECT=24,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}